PHEEEEELLLLLEEEEP t1_j8bac1k wrote on February 13, 2023 at 1:12 AM

Reply to comment by thundergolfer in [D] What ML dev tools do you wish you'd discovered earlier? by TikkunCreation

Why is airflow bad and can you suggest alternatives? I'm using airflow now with no issues

thundergolfer t1_j8bjgpu wrote on February 13, 2023 at 2:19 AM

If you don't have issues then definitely don't bother migrating! Something like Metaflow or Modal is much more built for purpose. Airflow was designed for the Hadoop era of data engineering; it's straining under changes that have happened in the Python, container, and ML ecosystems.