When it comes to Big Data the technical challenges in a real world scenario are usually complex but exciting and on the edge. Technology does not yield for legacy systems and at some point everyone has to migrate. Moving systems to the cloud is a hot topic. Cloud solutions allow for near-infinite scaling with the push of a button while only paying for what you really use, therefore dramatically improving efficiency while decreasing cost. Move your data to the cloud and you will be in an ecosystem that can store and process all of your data, run all kinds of ML algorithms, and enable all the critical analyses that can boost your business.
This is what we are doing at one of our clients right now. We migrate their data platform to a Google Cloud solution, build a versatile ETL/ELT platform and enable teams to use this new stack. Along this journey we are facing a variety of challenges no one told us about when we were at university: Coaching to work data-driven, dealing with legacy systems and most importantly: building trust with stakeholders across the board.
Meet HPI alumnus Frederic Schneider, Pascal Ackermann, and Afshin Loni. Afshin is working as a backend/DevOps engineer and in his daily routine, he is tackling the challenges of the infrastructure and the ETL jobs running on it. Pascal is working in Data Engineering and drove initiatives for building a data-driven mindset in his project. He deeply cares about building genuine and meaningful relationships between Netlight and the client. Frederic is a data engineer working in big data batch- and streams-processing and currently supports his client in migrating their on premise data lake infrastructure to the cloud and implementing GDPR compliant user tracking systems and processes.
If you want to participate, please put down your name in our registration form.