Software Engineer II (Backend + Data pipelines)

About the role

Scribd’s ML Data Engineering team is looking for a Software Engineer II to design, build, and optimize large‑scale distributed systems that extract, enrich, and process metadata across all Scribd brands. You will collaborate with machine‑learning engineers, product managers, and other cross‑functional partners to bring ML and LLM‑powered services into production pipelines.

Key responsibilities

• Design and implement backend services that handle metadata extraction and enrichment at massive scale.
• Integrate machine‑learning models and LLM‑based APIs into data pipelines.
• Optimize performance, reliability, and cost of distributed systems on AWS.
• Work closely with product and research teams to translate requirements into production‑ready solutions.

Required profile

• Strong backend development experience with a focus on scalability.
• Passion for solving complex data challenges and working with large‑volume datasets.
• Ability to collaborate effectively with ML engineers and product stakeholders.

Required skills

• Python
• Scala
• Ruby on Rails
• Airflow
• Databricks
• Spark
• HTTP APIs
• AWS Lambda
• AWS ECS
• AWS SQS
• AWS ElastiCache
• AWS SageMaker
• AWS CloudWatch
• Datadog
• Terraform