Lead Data Engineer
NIX, a global supplier of software engineering and IT outsourcing services, is looking for a Lead Data Engineer in its office in Budapest (Vaci Greens, 13th district). You’ll be part of a team of professionals who are ready to find the best tailor-made IT solutions for their multinational clients in various industries and solve complex problems.
Responsibilities:
- Leading and mentoring a team of data engineers
- Participating in the recruitment process to select new team members
- Leading the development of data engineering solutions
- Accurately estimating time and resources for new projects
- Providing technical oversight and guidance to the team
- Evaluating team performance and providing feedback and coaching
- Encouraging collaboration and open communication within the team and with other stakeholders
- Promoting a culture of continuous learning and improvement
- Managing team resources and identifying potential issues or bottlenecks
What we expect from you:
- Strong leadership and mentoring skills
- Experience in recruiting and building a team
- Experience with designing data pipelines and building ETL processes
- Ability to accurately estimate time and resources for projects
- Strong technical skills in code review, architecture, and data models
- Excellent communication and collaboration skills
- Ability to identify and address performance issues and recognize high performers
- Passion for continuous learning and improvement
- Ability to manage timelines and deadlines while ensuring high-quality work.
Required skills:
- 6+ years of proven experience developing software using an object-oriented or a functional language;
- Strong programming skills in Python or Scala/Java;
- Proficient with stream processing using the current industry standards (e.g. AWS Kinesis, Kafka streams, Spark/PySpark, Flink, etc.)
- Solid with distributed computing approaches, patterns, and technologies (Spark/PySpark. Hadoop, Storm, Hive, Beam as a plus)
- Experience working with Cloud Platforms (GCP, AWS, Azure) and their data-oriented components;
- Proficiency in SQL and query tuning;
- Deep knowledge of data warehousing principles and modeling concepts (knowledge of data model types and terminology including OLTP/OLAP, (De)normalization, dimensional, star, snowflake modeling, cubes, and graph/NoSQL);
- Proven experience in modern data warehouse building using Snowflake, AWS Redshift or BigQuery;
- Expertise in the use of relational databases (PostgreSQL, MSSQL or MySQL) as well as non-relational (MongoDB)
- Experience with orchestration of data flows (Apache Airflow, Talend, Glue, Azure Data Factory);
- A team player with excellent collaboration skills;
- Minimum English level Upper +.
Will be a plus:
- Expertise in data storage design principles. Understanding of pros and cons of SQL/NoSQL solutions, their types, and configurations (standalone/cluster, column/row-oriented, key-value/document stores);
- Deep knowledge of Spark internals (tuning, query optimization);
- Experience with data integration and business intelligence architecture;
- Experience with data lakes, data lake houses (Azure Data lake, Apache Hudi, Apache Iceberg, Delta lake);
- Experience with containerized (Docker, ECS, Kubernetes) or serverless (Lambda) deployment;
- Good knowledge of popular data standards and formats (e.g., JSON, XML, Proto, Parquet, Avro, ORC, etc.);
- Experience with Informatica, Databricks, Talend, Fivetran, or similar;
- Experience in data science and machine learning with building Machine Learning models.
What we offer:
- Stable long-term work environment
- Paid English courses and conversation clubs
- Opportunities for professional and personal growth
- Mentoring program, internal and external professional training programs
- Comfortable office in the 13th district of Budapest
- Every necessary tool and device in the office will be provided to comfortably perform all project tasks: computers, meeting rooms, spacious modern kitchens with professional coffee machines, comfortable recreation areas with game consoles, board games, and a selection of literature for every taste
- Support and care from our friendly team
If you feel you’re ready to join the team, email your resume to [email protected] or fill out a resume form now, and put an online interview on your schedule at your convenience. We’re already looking forward to meeting you!