Senior Data Engineer at Appodeal

<div class="content-intro"><p><strong>Appodeal</strong> is a dynamic US-based product company with a truly global presence.</p> <p>We have offices in <strong>Warsaw, Barcelona and Parkland (FL), </strong>along with remote team members located around the world.</p> <p>Our company thrives on diversity, collaboration, and innovation, making us a leader in the mobile app monetization space.</p> <p><strong>Why Appodeal?</strong></p> <p>At Appodeal, we’re more than just a company—we’re a team united by a common mission: <strong>Help people discover and grow their talents through products that enable successful mobile app businesses!</strong></p> <p>We take pride in our cutting-edge product and our internationally dispersed team of talented professionals.</p> <p>Here’s what we value, and what we hope you do too:</p> <ul> <li><strong>Continuous Learning and Growth:</strong> We are passionate about learning, growing personally, and building rewarding careers.</li> <li><strong>Making an Impact:</strong> We are committed to building a history-defining company that leaves a lasting impact on the mobile app industry.</li> <li><strong>Solving Exciting Challenges:</strong> We tackle complex problems every day, supported by a team of world-class professionals and mentors.</li> <li><strong>Enjoying the Journey:</strong> We believe in having fun while working toward our goals.</li> </ul></div><p>We are seeking a skilled Data Engineer to join our <strong>Mobile Growth Platform UA team</strong> in Barcelona. The ideal candidate will be responsible for building, maintaining, and optimizing our data infrastructure, ensuring seamless data flow and accessibility for ML and DA, analytical and business needs.</p> <p><strong><br>Key Responsibilities:</strong></p> <ul> <li>Design and build scalable data pipelines: Architect, construct, and maintain robust ETL/ELT pipelines using the Databricks platform (Apache Spark, Delta Lake, Delta Live Tables) for batch and streaming data ingestion from various sources.</li> <li>Manage data architecture: Define and maintain a scalable and secure data platform architecture that integrates Databricks (for data lakehouse management and complex transformations) with specialized OLAP engines (ClickHouse/Druid for fast querying).</li> <li>Design, develop, test, and orchestrate data workflows to streamline pipelines.</li> <li>Optimize performance and reliability: Monitor, troubleshoot, and fine-tune data workflows and database performance (e.g., Spark job optimization, ClickHouse schema tuning, Druid data partitioning) to ensure maximum efficiency and reliability.</li> <li>Contribute to the development of internal tools for automating data processes and business workflows, enhancing efficiency and scalability.</li> <li>Collaborate closely with product, MLOps and data science teams to ensure an optimal data experience for all ML practitioners and data consumers.</li> </ul> <p><strong><br>Requirements:</strong></p> <ul> <li>3-5+ years of professional work experience in data engineering.</li> <li>Strong expertise in Python and common data frameworks (Pandas, PySpark).</li> <li>Experience with modern data storage solutions: Data lakes (Delta tables), and data warehouses.</li> <li>Experience with data orchestration tools (Dagster, Airflow).</li> <li>Experience with streaming technologies (Kafka, Spark structured streaming).</li> <li>Experience with cloud platforms (AWS S3, EC2 etc.)</li> <li>OLAP Databases: Hands-on experience with ClickHouse and/or Apache Druid for real-time analytics and low-latency data serving.</li> <li><strong>Strong problem-solving skills and ability to excel in a fast-paced startup environment.</strong></li> <li><strong>Based in Barcelona or ready to relocate to Barcelona</strong>.</li> </ul> <p><br><strong>Nice to have:</strong></p> <ul> <li>Experience with Databricks platform.</li> <li>Experience in building ML data platforms.</li> </ul><div class="content-conclusion"><p>With an outstanding product and a mission that excites and inspires, Appodeal offers a unique opportunity to make an impact while being part of an amazing team.</p> <p><strong>Join us</strong> and help shape the future of mobile app success!</p></div>