If you’d like to look further into the future, the Milestones board has a column for each upcoming milestone.
Be aware that issue milestones serve more as a rough indication of relative priority than as hard deadlines, since short-term priorities can change quickly in response to community feedback, and it’s hard to predict how much progress can be made in a week.
These efforts are the foundation of our larger vision to enable a full DataOps OS. To learn more about our strategy around the DataOps OS, check out this blog post.
Our product development roadmap is driven by our company goals. For 2022 the goals that are relevant to product are:
These goals can be broken dodwn further into large work items.
We have a Roadmap Board to connect these high-level goals to specific work items in the near-term.
As this projects out into the future it is subject to change based on feedback. Don’t see something you want on the roadmap? Make an issue and let us know!
This specifically means that MeltanoHub will be the only source for Meltano to understand what plugins are avialable for installation. This also implies specific features such as a lock file that prevents breaking changes when plugin definitions change as well as updates to the Hub APIs and how Meltano consumes those APIs.
For the MVP, we’ve decided to implement Snowflake as the primary cloud vendor. Everything else for the MVP will be an open source option:
The MVP will be launched as Meltano 2.0 where we will also be deprecating legacy features and eliminating tech debt.
Having a clear and stable API for interacting with Meltano via the command line and user interface will enable us to iterate faster on feature development. This also unlocks use cases for users that we may not be able to directly address in either the CLI or UI.
Our goal with Meltano is not to create yet another orchestrator. We aim to simplify common cross-plugin workflows in a way that makes it easy to integrate with dedicated orchestrators. With our OS framing in mind we will rework how jobs and tasks are defined and how those DAGs are sent to orchestrators for execution.
With MeltanoHub as a the source of truth for plugins, the community will be able to add any arbitrary plugins as long as they meet the minimum level of quality. Meltano will invest in increasing the level of support for specific plugins within different categories including Dagster for Orchestration, Soda for Data Quality, Clickhouse and DuckDB for data warehouse, Lightdash and mProve for Analysis, and more. These choices will be driven by user feedback and data.
As we make progress towards offering a managed Meltano service, we will invest in relevant deployment options for ourselves and our community. We want to work with the community on this - if you’re interested in becoming a design partner for the managed service, please reach out via Slack.