Data engineer

Описание:

For our client, an innovative technology company in data analytics and digital business models, we are seeking a Data Engineer (m/f/d) for a full-time position in Berlin, starting as soon as possible. The company helps its clients optimize data-driven business processes and make well-founded decisions based on modern data architectures. In this role, you will play a key part in building, operating and further developing high-performance data platforms. You will design scalable data pipelines, integrate data from various source systems and provide the technical foundation for analytics, reporting and machine learning applications.

Задачи:

• Designing, developing and operating scalable data pipelines for processing large volumes of data
• Integrating and preparing structured and unstructured data from various source systems
• Developing and optimizing ETL and ELT processes for reliable data provision
• Building and further developing modern data warehouses and data lakes
• Modeling and transforming data for analytics, reporting and business intelligence applications
• Developing and maintaining automated data processing workflows with Python and SQL
• Implementing and optimizing data architectures based on modern cloud platforms
• Ensuring data quality, data consistency and data availability through appropriate validation and monitoring processes
• Optimizing existing data pipelines for performance, scalability and maintainability
• Collaborating with data scientists, data analysts and business units to provide suitable data foundations
• Implementing security, data protection and governance requirements within the data infrastructure
• Documenting data models, interfaces and technical processes
• Actively contributing to the further development of the data platform and to digitalization and automation projects

Требования:

• Successfully completed degree in computer science, business informatics, data science or a comparable qualification
• Several years of professional experience in data engineering, data integration or building modern data platforms
• Strong knowledge of SQL and practical experience developing with Python
• Experience with ETL and ELT processes and integrating various data sources
• Good knowledge of relational databases and modern data warehouse technologies
• Experience with cloud platforms such as AWS, Microsoft Azure or Google Cloud Platform
• Understanding of data modeling, data quality and scalable data architectures
• Experience with Git, automated testing and modern CI/CD processes
• Structured, analytical and solution-oriented approach to work
• Strong commitment to quality and an interest in modern data architectures and data-driven business models
• Team player with strong communication skills when working with technical and business stakeholders
• Very good German and English skills
• Будет плюсом: Knowledge of technologies such as Apache Spark, Apache Airflow or dbt is an advantage; Ideally, practical experience with Snowflake, Databricks, BigQuery or comparable data platforms; Knowledge of Docker and Infrastructure as Code is desirable

Условия:

• Permanent position at an innovative, growth-oriented technology company
• Responsible role with a high degree of independence and technical freedom to shape solutions
• Work on modern data platforms and challenging data projects
• Use of current cloud technologies and scalable data architectures
• Opportunity to actively shape data models, pipelines and technical standards
• Modern working environment with agile development processes and short decision-making paths
• Close collaboration with data scientists, data analysts and software developers
• Freedom to help select and further develop suitable technologies
• Individual training and development opportunities in data engineering and cloud computing
• Long-term prospects in a forward-looking market environment
• Attractive location in Berlin with good access to the digital business and technology scene