A Dockerized tutorial with everything you need to turn a .csv file of timestamped data into a Kafka stream — With more and more data science work moving towards real-time pipelines, data scientists are in need of learning to write streaming analytics. While some great, user-friendly, streaming data pipeline tools exist (my obvious favorite being Apache Kafka.) …

A fully-reproducible, Dockerized, step-by-step tutorial for building an API for your sklearn model — A common problem in machine learning is the fumbling handoff between the data scientists building machine learning models and the engineers trying to integrate these models into working software. The compute environment that data scientists are comfortable with doesn’t always slide nicely into production quality systems.

How astronomers deploy real-time pipelines to distribute data from the millions of objects discovered each night by modern telescopes — This post on data streams was originally published on HighAlpha.com. You might think that data collection in astronomy consists of a lone astronomer pointing a telescope at a single object in a static sky. While that may be true in some cases (I collected the data for my Ph.D. thesis…

A fully-reproducible, Dockerized, step-by-step tutorial for dipping your toes into the data stream. — This post on data stream processing was originally published on HighAlpha.com. With today’s terabyte and petabyte scale datasets and an uptick in demand for real-time analytics, traditional batch-oriented data processing doesn’t suffice. To keep up with the flow of incoming data, organizations are increasingly moving towards stream processing.