Data Engineer (f/m/d)

 StepStone ·  08.01.2019 ·  Karlsruhe ·  1&1

With our strong brands 1&1, GMX, WEB.DE and and over 30 million active users, we are the leading provider of consumer applications in Germany. We make communication even more secure – despite 500 million incoming emails a day!

The Big Data & Artificial Intelligence Competence Centre is the hub for digitalisation within 1&1. We deliver business value through provision of innovative data products and services powered by the latest Big Data & AI concepts and technologies. We are a small self-directed team and individuals are empowered and expected to lead their topic areas. We offer the ability to work on exciting projects within a dynamic environment, to develop yourself and to realise your potential. You will:

Be a key member of our cross-functional BAICC team and lead data transformation and provision topics.

Be responsible for evolving our data pipeline infrastructure to support Data Science and operational services.

Ensure ongoing alignment of data pipelines with Data Governance, Data Protection and Information Security policies.

Work with partners across the organisation to source, transform and deliver high-quality data.

To excel in this role, you have experience conceptualising and implementing robust end-to-end data pipelines for analytics and machine learning, utilising state-of-the-art streaming and batch technologies in a complex big data technology stack. In addition:

You are experienced in transferring machine learning models (Python, R) into operational pipelines and in sourcing data from relational and non-relational databases through SQL or other query languages.

You have extensive experience in programming with Python, Java, Scala or similar (object-oriented and functional).

You have solid experience with Big Data technologies such as Spark, MapReduce v2, Ceph, Kafka and elastic stack.

You have experience defining and/or implementing data APIs and data protection techniques including pseudonymisation and encryption.

You possess excellent English or German language skills and enjoy working in international environment teams. — ein Projekt von DIPLANET Digital Solutions Impressum