Senior Software Engineer, Data Platform at Covariance.ai

<p>Hiring for multiple roles.</p> <p>Traditional forecasting breaks under petabytes of features, megabytes of labels, and&nbsp;time-varying noise. Our breakthrough research is foundational in the field: generating industry-beating results (<a href="https://www.covariance.ai/#research-press-section">MIT News</a>). Our predictive engines combine a wide variety of data through rigorous scientific process.&nbsp; We leverage alternative datasets (consumer transactions, geolocation, etc) along with private, public, external, and internal data.&nbsp;</p> <p>The Data Platform is a critical component in our scientific approach to forecasting. The role will require everything from high-level architecture design to performant implementation.</p> <p><strong>Responsibilities include:&nbsp;</strong></p> <ul> <li>Build distributed systems supporting complex transformations over petabyte-scale data</li> <li>Design, implement, and maintain production cloud data pipelines for complex, disparate datasets</li> <li>Work closely with our Quants and Applied Scientists to support rigorous scientific process, rapid experimentation, and new product initiatives&nbsp;&nbsp;</li> </ul> <p><strong>Required qualifications:&nbsp;</strong></p> <ul> <li>Bachelor’s or advanced degree in Computer Science, math or equivalent&nbsp;</li> <li>3+ years of experience in data engineering or related fields with a track record of building (coding) and scaling a data platform</li> <li>2+ years of industry experience building ETL pipelines in a major cloud provider</li> <li>Highly proficient in python and SQL</li> <li>Advanced knowledge of databases, design patterns, OOP, and concurrency</li> <li>Knowledge of data management fundamentals and data storage principles</li> <li>Passion for intuitive data models&nbsp;</li> <li>Experience communicating with senior management as well as colleagues from engineering, analytics, and business backgrounds</li> <li>Experience with AWS, orchestration platforms, and modern tech stacks</li> <li>Strong software engineering fundamentals: system design, algorithms, data structures</li> </ul> <p><strong>Nice-to-haves:</strong></p> <ul> <li>Experience building systems that integrate LLMs with large-scale data processing</li> <li>Working understanding of basic probability and statistics</li> <li>Experience implementing ML models</li> <li>Experience with DBT</li> <li>MS or PhD in STEM field</li> </ul> <p>In-person at our NYC office strongly preferred.&nbsp; Remote candidates who can spend some time in-office (e.g., monthly) will also be considered.</p> <p><strong>Benefits:</strong></p> <ul> <li>The salary range for this position is $145,000-$220,000</li> <li>Free health, vision, dental insurance</li> <li>401k with match</li> <li>Unlimited PTO + 13 company holidays</li> <li>Daily Grubhub lunch stipend</li> <li>Pre-tax commuter benefits</li> </ul>