Senior Software Engineer - Big Data
About the Role:
As a software engineer, you will be working on a close-knit (~3-5 person) focused team to take ownership of a problem and deliver a high-quality solution at blazing velocity using a modern data stack.
Example projects include:
- Design and engineer a machine learning platform to put models into production efficiently for a med device company
- Design and engineer modernization of a data streaming and analysis system for an adtech business
What We’re Looking For:
We are hiring Software Engineers at all levels. Our interview process is designed to map your background and experience to our leveling and to enable you to be successful in the role. We’re excited to talk to you if you are passionate about data, hit SOME of these bullets strongly, and are motivated to learn the rest:
- Understand shepherding a project through a complete lifecycle - from discovery to deployment - using a sprint based incremental development approach
- Have experience building and orchestrating data management pipelines using tools such as Airflow, Prefect, or Dagster
- Are comfortable in languages like Python, Java, and Scala, having an ability to understand tradeoffs between languages, be an expert in at least one and capable of picking up others depending on project demands.
- Understand modern data storage and processing tools and their tradeoffs - SQL vs. NoSQL database technologies, in memory, and distributed database systems, and tools such as PostgresSQL, Cassandra, Hive, Spark, Redshift, Kafka, Hudi or Iceberg
- Have worked in CI/CD environments and understand scalable deployment and operational management (DevOps) techniques
- Are comfortable working with a cloud environment (i.e. AWS, Azure, GCP)
- Understand that the value that comes from pausing your work to answer a question or provide guidance
Apply Now