We’re excited to announce the Normal Availability of Lakeflow Join for Salesforce and Workday. Lakeflow Join introduces no-code ingestion connectors for fashionable SaaS purposes, databases, and file sources—enabling you to construct scalable ingestion pipelines and unlock the total energy of your information with the Databricks Information Intelligence Platform. The Salesforce and Workday connectors are the primary managed connectors to be launched to GA because the Lakeflow Join announcement final July, with many extra on the way in which.
Lakeflow Join’s managed information connectors are powered by serverless compute and can be found throughout AWS, Azure and GCP. They’re absolutely built-in with the Information Intelligence Platform for governance, observability and enterprise safety.
Lakeflow Join is the primary of three parts launched as a part of Lakeflow, the unified engineering resolution for ingestion, transformation and orchestration. It really works seamlessly with DLT for transformation and Databricks Workflows for orchestration.
Early adopters like Porsche Holding, Insulet, Equiniti, Stroër SE & Co. and Flick are already utilizing Lakeflow Join to resolve a few of their hardest information challenges.
Information silos trigger ingestion complexity, inefficiency
Right now, it’s troublesome to construct and preserve ingestion pipelines for SaaS purposes your self as a result of every API is exclusive and modifications typically. In the meantime, database ingestion will be much more complicated, typically requiring further infrastructure equivalent to digital machines for extraction instruments, Kafka for streaming, and a powerful understanding of change information seize (CDC) applied sciences for environment friendly ingestion.
Because of this, organizations spend a whole lot of time constructing, optimizing, and sustaining a patchwork of pipelines. This slows down tasks and may create a fragmented ETL structure that’s troublesome to control. It additionally forces extremely expert information engineers to spend time shifting information and monitoring pipelines as an alternative of growing strategic improvements.
Constructed-in information ingestion assist for Salesforce and Workday
Lakeflow Join eliminates these challenges by making it straightforward to create production-ready pipelines with just a few clicks within the UI or just a few traces of code. Underneath the hood, ingestion is environment friendly, with incremental updates and optimized API utilization. As your managed pipelines run, we maintain schema evolution, seamless third-party API upgrades, and complete observability with built-in alerts.
“With the Salesforce connector, we efficiently decommissioned 4 companies, which considerably streamlined our tech stack and lowered our prices. This integration not solely simplified our structure but additionally improved our operational effectivity, permitting us to concentrate on delivering extra worth with fewer sources.”
— Simon Salmeri, Head of Information Platform, Ströer
Lakeflow Join for Salesforce means that you can pair Databricks’ superior analytics and AI instruments with Salesforce’s CRM information to construct a more practical vendor expertise: predicting gross sales traits, deepening insights into buyer behaviors, and personalizing engagement methods. The connector helps Salesforce-specific necessities, like customized objects and method fields.
“We’ve been utilizing the Lakeflow Join Salesforce connector for a advertising segmentation use case. Our Salesforce information holds essential details about our prospects, and the connector has been the lacking piece to carry this dataset into our lakehouse.… We are actually at only the start of understanding our prospects higher and enhancing their expertise.”
— Ana-Maria Mocanu, Information and Insights Lead, Flick
Databricks and Salesforce introduced a strategic partnership in 2023 to construct sturdy integrations for our joint prospects. Since then, we launched the zero-copy Salesforce Information Cloud Connector so prospects can uncover, question, and govern Salesforce Information Cloud straight from Unity Catalog. Paired with Lakeflow Join for Salesforce, prospects can use each their CRM information and their CDP information inside Databricks.
Lakeflow Join for Workday additionally supplies easy, low-maintenance ingestion. You’ll be able to entry customized Workday studies for centralized analytics in your worker workforce.
Each connectors seamlessly combine with the Information Intelligence Platform, so you should utilize:
- DLT to rework information declaratively and replace transformations incrementally as information continues to stream in
- Databricks Workflows to orchestrate these pipelines
- Databricks Asset Bundles (DABs) to handle steady integration and supply
- Superior analytics and machine studying instruments to drive enterprise worth
- Unity Catalog to control your information and pipelines
- Lakehouse Monitoring to take care of the standard of your information
Driving high-value enterprise use circumstances
Lakeflow Join helps unlock high-value use circumstances throughout numerous industries, equivalent to understanding buyer habits, analyzing HR information, or figuring out upsell alternatives.
A typical use case is predicting buyer churn. Within the video beneath, we reveal how a retailer can do that by ingesting Salesforce buyer order information and mixing it with buyer interactions throughout different channels for enriched insights.
Demo: Find out how to use Lakeflow Join for Salesforce to foretell buyer churn.
One other use case is making a buyer assist dashboard for executives and assist groups. You’ll be able to even use LLMs to diagnose the traits that seem within the dashboard, as proven in this step-by-step weblog put up.
For human sources departments, the Workday connector can assist monitor and predict HR traits, equivalent to worker turnover. For instance, you possibly can ingest related Workday studies, remodel them with DLT, and incorporate the outcomes into an AI/BI dashboard.
A whole lot of shoppers utilizing Lakeflow Join
Clients are already ingesting information from quite a lot of sources with Lakeflow Join.
As one of many world’s most profitable automotive corporations, Porsche Holding Salzburg (Porsche) is Europe’s largest automotive retail firm with operations in 23 nations. Porsche needed to handle their information integration challenges and streamline entry to their buyer information in Salesforce Gross sales Cloud. Utilizing Lakeflow Join, Porsche was in a position to ingest information from Salesforce, remodel it in batch and streaming modes, and deploy and function the pipelines in manufacturing. Right now, the Databricks Information Intelligence Platform types the core of the Porsche group’s Information Platform. Be taught extra about Porsche’s success utilizing Lakeflow Join.
“Utilizing the Salesforce connector from Lakeflow Join helps us shut a essential hole for Porsche from the enterprise aspect on ease of use and value. On the shopper aspect, we’re in a position to create a very new buyer expertise that strengthens the bond between Porsche and the shopper with a unified and never fragmented buyer journey.”
— Lucas Salzburger, Undertaking Supervisor, Porsche Holding
Insulet is a medical system firm that developed the Omnipod product platform, and so they had been an early adopter of Lakeflow Join. With a mission to simplify life for folks with diabetes and different situations, they sought to faucet into their CRM insights to higher perceive their buyer wants. They used the Salesforce connector to cut back their ETL latency from days to minutes—enhancing the decision course of for his or her prospects with close to real-time insights.
“The LakeFlow Join’s Salesforce connector was particularly vital because it allowed us to straight ingest buyer suggestions, gross sales information and repair interactions from the Salesforce CRM into Databricks. LakeFlow Join fully modified how we deal with Salesforce information. We removed unreliable middleware and may now analyze all the things straight in Databricks – quicker and with much less guide effort.”
— Invoice Whiteley, Senior Director of AI, Analytics and Superior Algorithms, Insulet
Equiniti (EQ) is a world chief in shareholder, pension, and remediation companies, and so they needed to centralize information and insights into their operations. Utilizing Lakeflow Join for Salesforce, Workday, and SQL Server, EQ seamlessly solved for ingestion—thus liberating up essential engineering expertise to concentrate on utilizing Mosaic AI to boost the shopper expertise for his or her 6,000 corporations throughout 136 nations. For EQ, the power to seamlessly create no-code integrations to their core platforms helped them save time and extra prices, letting them concentrate on worth multipliers like Gen AI purposes. Find out how EQ constructed a safe and unified information and AI platform in three steps.
Getting began with Lakeflow Join
Information groups can now use Lakeflow Connect with construct environment friendly, incremental pipelines at scale, with only a few clicks or traces of code. Get began right this moment with the Salesforce or Workday connector to assist unlock high-value use circumstances, equivalent to predicting buyer churn, working customized buyer analytics, and figuring out upsell alternatives.
Lakeflow Join’s roadmap contains further connectors like SQL Server, Google Analytics, ServiceNow, SFTP, SharePoint, and PostgreSQL. Keep tuned for extra bulletins this 12 months, or attain out to your Databricks account staff in case you’re enthusiastic about becoming a member of a preview for early entry.
Lakeflow Join has a compute-based pricing mannequin. Salesforce and Workday, which run solely on serverless infrastructure will incur serverless DLT DBT expenses. See extra particulars on charges.
To get began with Lakeflow Join for Salesforce and Workday, you possibly can assessment the documentation or strive this resolution accelerator.
