My name is Guillaume Payen, I live in Paris, France, and I am currently working as a Data Architect. I have worked a lot on data processing, infrastructure, and also DevOps. As for now, I am actively working on the challenges of streaming data processing, and the impacts this paradigm has on the way processing is done, the way machine learning algorithms for streaming data are built, and the way architectures are designed to ensure reliability, elasticity, and resilience.
This is also why, in addition to the missions I am working on, I spend some time bootstraping on some personal projects, such as streaming data analysis over MLB and NHL games (boxscores), and streaming data processing over TFL open data. Those projects get me to dig deep into technologies such as Flink, Kubernetes, Akka, Kafka, Spark, and NoSQL databases such as Cassandra, MongoDB, ElasticSearch, or MemSQL. These projects also make me consider the functional part of the challenges, whereas – as engineers – we usually stick to the technics.
Through this blog, I would like to speak about data, engineering and architecture, and help making tough big data concepts readable, understandable and interesting. Todo so, I will try to mix medias. You will get access to written posts, informative videos, and podcasts. I hope that this content available to you will help you understand the functional and technical challenges Big Data arises today.
If you like my work, if my content makes sense to you, you can certainly subscribe to my newsletter. The Moonshots letter is THE way to stay updated, and benefit from some exclusive content.
In the meanwhile, my wish is that you spend a good time on my blog. If you have any questions, please let me know.