SDET 3 - Model Evaluation at AiDASH

Bengaluru, Karnataka, India; Gurugram, Haryana, IndiaFull-timeR&DPosted 3 days ago

About the Role

<div class="content-intro">About AiDASH AiDASH is leading the PreventionFirst™movement for electric utilities and transforming grid resilience through its pioneering platform that unifies vegetation, asset, storm, and wildfire intelligence. Powered by SatelliteFirst™ Inspection & Monitoring, AiDASH delivers comprehensive visibility across the entire grid at the right frequency and budget, using the right data modality. More than 200 customers trust AiDASH to keep the lights on, spend where it counts, and defend every decision, Securing Tomorrow across every mile of the grid. Learn more at <a href="https://www.aidash.com." target="_blank">www.aidash.com.</a> The PreventionFirst movement is growing, and so is the recognition behind it. In 2026, Forbes named AiDASH one of America's Best Startup Employers for the 4th consecutive year, and TIME included AiDASH among America's Top GreenTech Companies for the 3rd year in a row. <a href="https://www2.deloitte.com/us/en/pages/technology-media-and-telecommunications/topics/north-america-technology-fast-500.html?utm_source=bngaiwebsite&utm_medium=referral&utm_campaign=evolve-banner">Deloitte Technology Fast 500</a>™ ranked AiDASH No. 12 in the San Francisco Bay Area, and No. 59 overall in their selection of the top 500 for 2024.  Join us in Securing Tomorrow Together! </div><h4>The Role </h4> The Platform ML team deploys and validates every ML model behind Aidash’s products. These models process satellite imagery, geospatial data, and weather data. As an SDET-3, you will own end-to-end quality for these models, from training data preparation through inference pipelines to performance at production scale. You will validate both functional correctness and scaling behavior, and you will use agentic AI tools to move faster without lowering engineering standards. How You’ll Make an Impact: <ul> <li data-leveltext="" data-font="Symbol" data-listid="11" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="1" data-aria-level="1">Own model quality before production. Build validation frameworks for computer vision models (preferably satellite or geospatial). Catch regressions in accuracy, precision/recall, and IoU before they reach customers. </li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="11" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="2" data-aria-level="1">Build version-aware model regression. Set up pipelines that compare inference outputs across model versions on curated golden datasets. Every release should come with a clear, data-backed go/no-go signal. </li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="11" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="3" data-aria-level="1">Make data quality a first-class gate. Validate training and evaluation datasets for label quality, class balance, geographic and seasonal coverage, leakage, and drift. Ensure models are tested on data that reflects real-world conditions. </li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="11" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="4" data-aria-level="1">Validate inference at scale. Design load and benchmark tests for inference services and batch pipelines. Find the throughput, latency, and cost limits on AWS and Kubernetes before customers do. </li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="11" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="5" data-aria-level="1">Harden the platform end-to-end. Automate API, contract, and data-pipeline tests across distributed services. Use logs, metrics, and traces to speed up root-cause analysis. </li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="11" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="6" data-aria-level="1">Raise the bar for the team. Strengthen the shared automation frameworks and set standards for maintainable, non-flaky tests. Show how tools like Cursor and Claude can speed up test authoring, triage, and reporting while staying under human review. </li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="11" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="7" data-aria-level="1">Influence release decisions. This is a high-visibility role. Your quality signals will directly shape what ships across Aidash’s product lines</li> </ul>   What we’re looking for:    We are looking for a senior QA engineer with deep backend automation experience who can validate ML models and backend systems end-to-end, and who actively uses agentic AI development tools (e.g., Cursor, Claude) to accelerate test design, automation, debugging, and reporting — without compromising fundamentals, coverage, or engineering quality.  <ul> <li data-leveltext="" data-font="Symbol" data-listid="20" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="1" data-aria-level="1">8–10 years in software testing and test automation, with strong ownership of backend system quality </li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="20" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="2" data-aria-level="1">Hands-on backend automation experience using at least one of:  </li> </ul> <ul> <li data-leveltext="o" data-font="Courier New" data-listid="20" data-list-defn-props="{"335552541":1,"335559685":1440,"335559991":360,"469769226":"Courier New","469769242":[9675],"469777803":"left","469777804":"o","469777815":"hybridMultilevel"}" data-aria-posinset="1" data-aria-level="2">Java + RestAssured Or Python + pytest </li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="20" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="3" data-aria-level="1">Experience testing ML applications (model/service behavior, data quality, inference pipelines, evaluation/regression of model-backed features) </li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="20" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="4" data-aria-level="1">Broader stack familiarity: observability (logs/metrics/traces), cloud (AWS), contract testing, data-pipeline validation </li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="20" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="5" data-aria-level="1">Experience improving shared automation frameworks and raising team standards for maintainable tests </li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="20" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="6" data-aria-level="1">Solid grasp of testing fundamentals and best practices (test design, risk-based coverage, isolation, maintainability, flaky-test control, clear defect/RCA discipline) </li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="20" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="7" data-aria-level="1">Strong coding ability in Java or Python (proficient in at least one), with willingness to learn the other (or additional languages) as needed </li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="20" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="8" data-aria-level="1">Good understanding of backend system design and how services interact in distributed systems </li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="20" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="9" data-aria-level="1">Practical exposure to databases — SQL and/or NoSQL (at least one is mandatory) </li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="20" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="10" data-aria-level="1">Working knowledge of application deployment and underlying orchestration (e.g., containers, Kubernetes, service rollout/health concepts) </li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="20" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="11" data-aria-level="1">CI/CD pipelines — must have (Jenkins/GitHub Actions/Bitbucket Pipelines or equivalent): triggering suites, reading failures, improving pipeline reliability </li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="20" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="12" data-aria-level="1">Performance testing — must have (JMeter/k6/Locust or equivalent): load/benchmark basics, interpreting results, flagging SLA/risk </li> </ul> <ul> <li data-leveltext="" data-font="Symbol" data-listid="20" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="13" data-aria-level="1">Exposure to agentic development tools such as Cursor and Claude (or similar) for coding, test authoring, log/triage assistance, and documentation — used with human review and quality gates </li> </ul> We are proud to be an equal-opportunity employer. We are committed to embracing diversity and inclusion in our hiring practices, and we promote a work environment where everyone, from any race, color, religion, sex, sexual orientation, gender identity, or national origin, can do their best work. <div class="content-conclusion"><div>We are committed to providing an inclusive and accessible interview experience for all candidates. Please let us know if you require any accommodation during the interview process, and we will make every effort to meet your needs. Read our Privacy Policy here: <a id="menur8uvg" class="fui-Link ___1q1shib f2hkw1w f3rmtva f1ewtqcl fyind8e f1k6fduh f1w7gpdv fk6fouc fjoy568 figsok6 f1s184ao f1mk8lai fnbmjn9 f1o700av f13mvf36 f1cmlufx f9n3di6 f1ids18y f1tx3yz7 f1deo86v f1eh06m1 f1iescvh fhgqx19 f1olyrje f1p93eir f1nev41a f1h8hb77 f1lqvz6u f10aw75t fsle3fq f17ae5zn" href="https://www.aidash.com/policy/privacy-policy/" target="_blank">https://www.aidash.com/policy/privacy-policy/</a>   </div></div>

About the Role

Related Roles