Senior Linux Infrastructure Engineer at tastytrade

Chicago, IllinoisFull-timett - InfrastructurePosted about 1 month ago

About the Role

Company:  tastytrade Role:  Senior Linux Infrastructure Engineer Location:  Chicago, IL — Hybrid  We are looking for a senior Linux engineer who is equal parts operator and builder. You will own the systems layer of our production environment — from the metal to the configuration management code. This is a hands-on role: you will jump into incidents, tackle challenging engineering problems, design systems that scale, and evaluate new software and architectures.  This is not a role where the abstractions hide the machine. You are expected to be curious about what is underneath and to be the person other engineers come to when a system is behaving in a way nobody can explain.  What You'll Do  <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="1" data-aria-level="1">Own Linux performance. Diagnose and tune systems under real production load: CPU scheduling and NUMA placement, memory and page cache behavior, disk and filesystem I/O, and network stack tuning. </li> </ul> <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="2" data-aria-level="1">Lead troubleshooting on hard problems. Work incidents methodically — form a hypothesis, find the cheapest test that falsifies it, and narrow the search rather than changing five things at once. Write postmortems, organize follow-up tasks, and future-proof the environment so the same issue does not recur. </li> </ul> <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="3" data-aria-level="1">Write and maintain configuration management code. Build infrastructure declaratively with Salt, Ansible, Chef, or Puppet, treating that code with the same standards as application code: reviewed, tested, and version-controlled. </li> </ul> <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="4" data-aria-level="1">Run containerized workloads. Build, deploy, and operate services on Kubernetes or Nomad, including scheduling behavior, resource limits, health checking, and the failure modes that only appear under contention. </li> </ul> <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="5" data-aria-level="1">Automate in Bash and Python. Replace manual runbooks with tooling and streamline repeatable work. </li> </ul> <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="6" data-aria-level="1">Operate core network services. Troubleshoot TCP/IP with confidence and bring solid networking fundamentals. Manage DNS and DHCP as production services — zone management, resolver behavior, TTL strategy, scopes, reservations, and relay configuration. </li> </ul> <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="7" data-aria-level="1">Operate the traffic and data tier. Configure and troubleshoot Nginx and HAProxy (routing, TLS termination, health checks, connection handling) and support Redis and RabbitMQ in production. </li> </ul> <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="8" data-aria-level="1">Manage virtualization. Provision and maintain guests across VMware, Xen, or KVM, including capacity planning, host maintenance, and live migration. </li> </ul> <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="9" data-aria-level="1">Handle secrets properly. Use Vault for secret storage, dynamic credentials, policy, and rotation — and help move the organization off whatever it was doing before. </li> </ul> <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="10" data-aria-level="1">Own observability. Maintain log aggregation on the Elastic Stack and alerting through Nagios, CheckMK, or Icinga. Tune alerts toward signal; an alert nobody can act on is a bug. </li> </ul> <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="11" data-aria-level="1">Work through change management and code review. Everything moves through Git and pull requests. You will review other people's changes as seriously as you expect yours to be reviewed. </li> </ul> Who You Are  <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="12" data-aria-level="1">6+ years in a Linux systems, infrastructure, or SRE role. </li> </ul> Expert-level Linux, specifically:  <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="13" data-aria-level="1">Performance analysis. You can go from a vague complaint to a named subsystem using the standard tooling — perf, strace, ss, iostat, bpftrace, or equivalents — and explain what the numbers mean. </li> </ul> <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="14" data-aria-level="1">Troubleshooting methodology. A disciplined, hypothesis-driven approach that works on a system you have never seen before. We care more about how you narrow the problem than about which commands you happen to know. </li> </ul> <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="15" data-aria-level="1">Systems fundamentals. Processes and signals, systemd, cgroups and namespaces, filesystems, and what actually happens when a host exhausts memory or file descriptors. </li> </ul> <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="16" data-aria-level="1">Declarative configuration management at production scale — Salt, Ansible, Chef, or Puppet. You have authored and maintained the code, not only run it. </li> </ul> <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="17" data-aria-level="1">Containerization and orchestration. Production experience with Kubernetes or Nomad, including the operational realities: scheduling, resource pressure, rollouts, and debugging a workload that will not start. </li> </ul> <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="18" data-aria-level="1">Scripting and automation. Strong Bash and working Python. You write code that other engineers can maintain. </li> </ul> <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="19" data-aria-level="1">Foundational networking. Comfortable across layers — VLANs and routing, DNS, DHCP, TCP behavior, and TLS — and able to determine whether a problem is the application, the host, or the network. </li> </ul> <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="20" data-aria-level="1">Proxy and load-balancing experience with Nginx or HAProxy. </li> </ul> <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="21" data-aria-level="1">Virtualization experience with at least one of VMware, Xen, or KVM. </li> </ul> <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="22" data-aria-level="1">Git and peer review as a daily habit, including the discipline to keep changes reviewable. </li> </ul> <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="23" data-aria-level="1">Excellent written communication. Runbooks, design proposals, and incident write-ups are a core part of this job, not an afterthought. </li> </ul> <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="24" data-aria-level="1">The ability to get productive quickly in areas where you do not yet have depth. </li> </ul> Preferred Qualifications  <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="25" data-aria-level="1">Production ownership of Redis or RabbitMQ as a primary responsibility rather than a dependency. </li> </ul> <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="26" data-aria-level="1">Vault administration — policies, auth methods, and rotation at scale. </li> </ul> <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="27" data-aria-level="1">Elastic Stack operations at volume: index lifecycle, mapping decisions, and cluster tuning. </li> </ul> <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="28" data-aria-level="1">Experience in a regulated environment, or anywhere downtime has a direct revenue cost. </li> </ul> <ul> <li data-leveltext="•" data-font="Aptos" data-listid="1" data-list-defn-props="{"335552541":1,"335559685":431,"335559991":215,"469769242":[8226],"469777803":"left","469777804":"•","469777815":"hybridMultilevel"}" data-aria-posinset="29" data-aria-level="1">Colocation or bare-metal experience: hardware lifecycle, remote hands, and capacity planning against a finite footprint. </li> </ul> Company Perks + Benefits:     <ul> <li>Performance Bonuses    </li> <li>Stock Purchase Options    </li> <li>Medical/Vision/Dental Benefits  </li> <li>401k Plan   </li> <li>20 Paid Vacation Days (plus an additional paid vacation day the month of your birthday!)    </li> <li>10 Paid Sick Days    </li> <li>Gym Membership Reimbursement    </li> <li>Commuter Benefits    </li> <li>Pet Insurance    </li> <li>Wellness & Mental Health Programs    </li> <li>Charitable Donation Matching    </li> <li>Two Paid Volunteer Days Off    </li> <li>Daily catered lunch when in the office    </li> <li>Full kitchen with snacks and beverages    </li> <li>In-building gym    </li> <li>Shuttle to/from Metra    </li> </ul> Base Salary Range: $140,000-$180,000 The actual salary offered will be based on the candidate's level of experience and qualifications.  Discretionary Performance Bonus: 10-12% of base salary based on individual and company performance.   About IGNA + tasty   IG North America is home to tastytrade, tastylive & tastyfx—a family of brands built to democratize trading and empower individual investors. Founded in Chicago by the creators of thinkorswim, acquired by London-based IG Group in 2021, we combine startup innovation with the backing of a FTSE 100 fintech operating across five continents serving over 1.3m customers and handling billions of dollars in transactions – built on scale, trust, and proof.  From our headquarters in Chicago's Fulton Market, our team builds award-winning trading platforms, produces live financial education content daily, and creates technology that makes complex markets accessible. tastytrade is our retail brokerage for self-directed investing and trading, with tastylive providing content to educate our customers. tastyfx is the fastest-growing forex broker in the US. tastycrypto provides self-custody digital wallets for decentralized finance.     We're a lean, collaborative team that values autonomy, pragmatism, and impact. Whether you're building technology, creating content, serving customers, or supporting operations, you'll work alongside people who are passionate about disrupting traditional finance and genuinely care about helping traders succeed. Our culture rewards initiative, embraces experimentation, and measures success by the value we create for our users. The bar is high – bring a curious and forward-thinking mindset and we'll give you the platform to define what comes next. Join us at IG|tasty – the future gets built here.      Location: Our office is in the West Loop - Chicago's growing center of tech, great cuisine, and high-end bars.   <a id="menurs0i" class="fui-Link ___1q1shib f2hkw1w f3rmtva f1ewtqcl fyind8e f1k6fduh f1w7gpdv fk6fouc fjoy568 figsok6 f1s184ao f1mk8lai fnbmjn9 f1o700av f13mvf36 f1cmlufx f9n3di6 f1ids18y f1tx3yz7 f1deo86v f1eh06m1 f1iescvh fhgqx19 f1olyrje f1p93eir f1nev41a f1h8hb77 f1lqvz6u f10aw75t fsle3fq f17ae5zn" href="https://tastytrade.com/">tastytrade</a> | <a id="menurs0k" class="fui-Link ___1q1shib f2hkw1w f3rmtva f1ewtqcl fyind8e f1k6fduh f1w7gpdv fk6fouc fjoy568 figsok6 f1s184ao f1mk8lai fnbmjn9 f1o700av f13mvf36 f1cmlufx f9n3di6 f1ids18y f1tx3yz7 f1deo86v f1eh06m1 f1iescvh fhgqx19 f1olyrje f1p93eir f1nev41a f1h8hb77 f1lqvz6u f10aw75t fsle3fq f17ae5zn" href="https://www.tastylive.com/">tastylive</a>  | <a id="menurs0m" class="fui-Link ___1q1shib f2hkw1w f3rmtva f1ewtqcl fyind8e f1k6fduh f1w7gpdv fk6fouc fjoy568 figsok6 f1s184ao f1mk8lai fnbmjn9 f1o700av f13mvf36 f1cmlufx f9n3di6 f1ids18y f1tx3yz7 f1deo86v f1eh06m1 f1iescvh fhgqx19 f1olyrje f1p93eir f1nev41a f1h8hb77 f1lqvz6u f10aw75t fsle3fq f17ae5zn" href="https://www.tastyfx.com/">tastyfx</a>   1330 W Fulton Market, Chicago, IL 60607           *Don't meet every single requirement? Studies have shown that women and people of color are less likely to apply to jobs unless they have every single qualification. Our team is dedicated to building a diverse, inclusive, and authentic workplace, so if you’re excited about this role, but your experience doesn’t align perfectly, we encourage you to apply anyway. You may be just the right candidate for this or other roles!

About the Role

Related Roles