Rewritten roadmap

ROADMAP.md

@@ -5,185 +5,118 @@ Roadmap
 - ✅ work item complete
 - 🦀 work item in progress
 - 💤 work item not started yet
-- ↑ updated version
-
-General Features
-================
-
-RELEASED
-
-rotonda 0.1
-rotonda-fsm 0.1
-roto 0.2
-routecore 0.4
-rotonda-store 0.3
-rotoro -
-
-- ✅ BMP listener
-- ✅ BMP proxy
-- ✅ single-threaded RIB implementation
-- ✅ lock-free, multi-threaded RIB implementation
-- ✅ client-specific runtime application with BMP ingress and RIBs
-- ✅ `roto` filtering language
-- ✅ BGP passive speaker
-- ✅ limited systemd functionality
-- 🦀 ~~BGP limited active speaker~~ POSTPONED
-- ✅ Documentation
-- ✅ Packaging
-
-NEXT RELEASE
-
-↑ rotonda 0.1.x
-  rotonda-fsm 0.1
-↑ roto 0.2.x
-  routecore 0.4
-  rotonda-store 0.3
-  rotoro -
-
-- 🦀 implement FilterMap (user-defined rx/tx and RIB storage type)
-- 🦀 implement passive external data source: RIBs
-
-NEXT RELEASES
-
-- 💤 support more AFI/SAFIs, e.g. FlowSpec, L2VPN, MPLS
-- 💤 emit BGP packets as events on OutputStream
-- 💤 egress modified/created BGP packets (on peering sessions)
-- 💤 RIB split over in-memory and on-disk
-- 💤 refactor configuration: dynamic units reconfiguration with RESTCONF/yang+json
-- 💤 implement active external data sources: RTR
-- 💤 more ingress connectors (e.g. Kafka, MQTT, mrt)
-- 💤 more egress connectors (e.g. Kafka, Parquet, mrt)
-- 💤 create plugin system
-- 💤 query engine over (split) RIBs.
-- 💤 Rotonda shell
-- 💤 Distributed `rotonda`-`rotonda` setup with `rotoro` (experimental)
 
 
-Development per Component
-=========================
+## `Rotonda`
+
+### NEXT RELEASE 0.2: Big refactor, features similar to 0.1
+
+- ✅ Move functionality from rotonda to rotonda-store
+- 🦀 Integrate changes from Routecore 0.5 & Roto 0.3
+- 💤 Simplify configuration format
+- 💤 Limited MRT import for testing
+
+### UNRELEASED 0.3: Collector functionality
+
+- 💤 Provide passive external data sources to Roto
+- 💤 On-disk storage to prevent growing memory use
+- 💤 More ingress connectors (e.g. Kafka, mrt)
+- 💤 Switch to daemon-base
+- 💤 Store other AFI/SAFI types than unicast & multicast
+
+### LATER RELEASES
+
+- 💤 CLI for querying RIBs
+- 💤 Emit BGP packets as events on OutputStream
+- 💤 Egress modified/created BGP packets (on peering sessions)
+- 💤 Refactor configuration: dynamic units reconfiguration with RESTCONF/yang+json
+- 💤 More egress connectors (e.g. Kafka, Parquet, mrt, (timescale) RDBMS)
+- 💤 BMP & BGP proxy
+- 💤 BMP out stream
+- 💤 Long-term file storage
+- 💤 Create experimental global registry
+- 💤 Snapshot/restore functionality
+- 💤 RIB diff functionality
+- 💤 Create experimental distributed Rotondas
+
 
 ## `Roto language`
 
-RELEASED 0.2
+### NEXT RELEASE 0.3
 
-- ✅ language lay-out
-- ✅ EBNF scheme
-- ✅ create experimental parser
-- ✅ create experimental compiler
-- ✅ create experimental virtual machine
-- ✅ implement all methods on `roto` types
-- ✅ integrate into `rotonda`
-- ✅ implement FilterMap (user-defined rx/tx)
-- 💤 ~create user-friendly error messaging~
-- 🦀 ~extensive stress testing
-- 🦀 create manual-like docs
-- ✅ create high-level overview documentation
+- ✅ Reimplemented as a compiled language using cranelift
+- ✅ Improved parsing error messages
+- ✅ Improved type checking error messages
+- ✅ New type checker
+- ✅ Syntax refinements
+- ✅ User-defined filter-maps
+- ✅ Basic types & operations (integers, bools)
+- ✅ Domain-specific types (asn, ip addr, prefixes)
+- ✅ Ready for hot-reload
+- ✅ Record and enum types defined by Roto script
+- 🦀 Runtime registering of types, functions & methods
+- 🦀 Drop implementation for runtime types
 
-UNRELEASED 0.2.x
+### UNRELEASED 0.4
 
-- 🦀 complete passive external data sources for RIBS
+- 💤 Schemas and dynamic types in Roto functions
+- 💤 Borrowed data in Roto
+- 💤 Complete passive external data sources for RIBS
+- 💤 Create dev documentation
+- 💤 Create reference-level documentation 
+- 💤 Create namespaces / modules system
 
-NEXT RELEASES
+### LATER RELEASES
 
 - 💤 implement more passive external data sources
 - 💤 implement active external data sources: RTR
-- 🦀 create reference-level documentation 
-- 💤 create namespaces / modules system
 - 💤 create user-configurable graph DSL for units
 - 💤 create user-configurable query DSL
-- 💤 create dev documentation
-
-
-## `Rotonda-fsm`
-
-RELEASE 0.1
-
-- ✅ BMP state machine
-- ✅ BGP state machine
-- ✅ BGP passive speaker (session management)
-
-UNRELEASED 0.2
-
-- 🦀 BGP active speaker
 
 
 ## `Routecore`
 
-RELEASE 0.4
+### NEXT RELEASE 0.5
 
-- ✅ prefix types
-- ✅ route record example types
+- ✅ Prefix types in `inetnum`
+- ✅ Route record example types
 - ✅ BGP/BMP types for parsing
+- ✅ Create BGP packet editor & route workshop
+- ✅ Partial FlowSpec parser
+- ✅ Best path selection
+- 🦀 Revamped AFI/SAFI with AddPath support
 
-UNRELEASED 0.5
+### UNRELEASED 0.6
 
-- 🦀 create BGP packet builder
-- 💤 partial FlowSpec parser
+- 💤 Optimizations
 
-NEXT RELEASES
+### LATER RELEASES
 
 - 💤 BGPsec parser
+- 💤 More AFI/SAFI types
+- 💤 Move BMP FSM from Rotonda to Routecore
+- 💤 Refactor BGP FSM with BoQ in mind
+- 💤 Type-aware wire format path attributes
 
 
-## `Rotonda`
-
-RELEASE 0.1
-
-- ✅ setup `tokio` skeleton with logging etc.
-- ✅ setup BMP listener
-- ✅ REST API setup
-- ✅ MQTT OutputConnector
-- ✅ integrate BGP passive listener (BGP EventSource)
-- ✅ virtual RIB experimental implementation
-- ✅ installation and usage documentation 
-- ✅ limited packaging
-- ✅ limited `systemd` integration
-
-UNRELEASED 0.1.x
-
-- 🦀 passive external data sources: RIBs
-- 🦀 implement FilterMap (user-defined rx/tx and RIB storage type)
-
-NEXT RELEASES
-
-- 💤 emit BGP packets as events on OutputStream
-- 💤 egress modified/created BGP packets (on peering sessions)
-- 💤 improved daemon functionality: drop privileges
-- 🦀 refactor configuration: dynamic units reconfiguration with RESTCONF/yang+json
-- 🦀 implement tracing
-- 💤 RIB split over in-memory and on-disk
-- 💤 namespaces / modules support
-- 💤 more ingress connectors (e.g. Kafka, mrt)
-- 💤 more egress connectors (e.g. Kafka, Parquet, mrt, (timescale) RDBMS)
-- 🦀 BMP proxy
-- 💤 create experimental global registry
-- 💤 snapshot/restore functionality
-- 💤 RIB diff functionality
-- 💤 create experimental distributed units
-
-
-## `Rotoro`
+## `Rotonda-store`
 
-MVP
+### NEXT RELEASE 0.4
 
-- 🦀 design wire protocol and select a layout (AVRO?)
-- 💤 create experimental de/serialization
-- 💤 experimental integration in `rotonda-runtime`
+- ✅ Multi-unique ID implemented (replacing MergeUpdate from rotonda 0.1)
+- ✅ Best path selection with caching
+- ✅ Optimization of route status using roaring bitmaps
+- 🦀 Optimizations: better hashing, cache padding, etc.
 
+### UNRELEASED 0.5
 
-## `Rotonda-store`
+- 💤 On-disk storage integration
 
-0.3
 
-- ✅ stabilize single-threaded store
-- ✅ stabilize multi-threaded store
-- ✅ robust error handling (get rid of all the unwraps)
+## `Rotoro`
 
-NEXT RELEASES
+### MVP
 
-- 🦀 stabilize API
-- 🦀 benchmarks matrix IPv4/IPv6 `local_array`/`local_vec`
-- 🦀 unit tests & acceptance tests matrix
-- 💤 optimizations: implement QSBR (replace Ref Counting on update)
-- 💤 optimizations: better hashing, cache padding, etc.
-- 💤 fuzzer IPv4/IPv6
+- 🦀 Design wire protocol and select a layout (AVRO?)
+- 💤 Create experimental de/serialization
+- 💤 Experimental integration in `rotonda`