Data Intelligence Engineer, Databricks

Every day, millions of shipments move around the world on data that nobody is looking at in real time. Orders, ASNs, invoices, and tracking events flow between 3PLs, forwarders, brands, and retailers through EDI and APIs, then get flattened into a status that tells you something went wrong only after it already has.

SwiftB2B exists to change that. We are an AI operating system for global supply chains. One platform where 3PLs, freight forwarders, brands, retailers, and manufacturers can see every item, shipment, and exception as it happens. The platform does not stop at flagging a delay. It works out what the delay costs, weighs the options, and starts the fix.

We built it on 15 years of SwiftAnt’s work in supply chain and EDI technology, and on a team that has spent careers in logistics, retail, and enterprise software. We know what a late container does to a retailer’s shelf, and we know what the data underneath it looks like.

That data is where you come in. The intelligence in SwiftB2B is only as good as the pipelines feeding it. We are a Databricks partner and we are building our data platform on the lakehouse. We want engineers who understand the full breadth of Databricks, from ingestion and Delta tables through Unity Catalog, Lakeflow, and Mosaic AI, and who can see how all of it applies to shipment data, customer profitability, emissions reporting, and the rest of the problems logistics companies live with.

What you will do

You will design, build, and run the data pipelines and models that power the visibility and decision-making in SwiftB2B. In practice that means:

• Ingesting and transforming data from logistics and enterprise systems (EDI feeds, TMS/WMS exports, ERPs, carrier APIs) into analytics-ready lakehouse tables on Databricks.
• Building and tuning ETL and ELT workflows, and modeling data for analytics, warehousing, and the AI features in the product.
• Owning data quality end to end: validation, lineage, monitoring, and fixing production issues when they happen.
• Working with product, engineering, and operations to turn messy supply-chain data into features customers use.
• Improving the platform as it grows, so it keeps up with more customers, more data, and more automation.

What we are looking for

• Real experience as a data engineer, building and maintaining pipelines and integrations that have run in production.
• Hands-on Databricks experience: Spark/PySpark, Delta Lake, medallion architectures, Unity Catalog, and job orchestration. Databricks certifications are a plus.
• Strong SQL and Python, and solid data modeling and warehousing skills.
• Experience designing, optimizing, and automating ETL/ELT processes on a cloud data platform (Azure preferred).
• Comfort with analytics: you can use data to answer a question, support a decision, and improve the product.
• A background in supply chain, logistics, or a related domain is a strong advantage. Familiarity with EDI (X12, EDIFACT) or enterprise integration is a plus.
• A degree in Computer Science, Data Engineering, Data Science, Information Systems, or a related field, or equivalent practical experience.
• You can explain complex data problems to non-engineers, work across teams, and take ownership of a solution from source system to customer-facing feature.

Not sure you tick every box?

Apply anyway. Nobody we have hired matched the list line for line. If you have shipped real pipelines and you are curious about how goods move around the world, we want to talk to you. A short note on what you have built and what you would want to work on here tells us more than a polished CV. If you have tried the demo and have opinions about it, even better, bring them.

Equal opportunity

SwiftB2B hires on skill, talent and curiosity. We do not discriminate on the basis of race, religion, nationality, gender, sexual orientation, age, disability, or any other protected characteristic. If you need an adjustment at any stage of the process, tell us and we will make it happen.