Javier Lagares is a Principal Information Engineer at HP, the place he leads the event of data-driven options for the 3D printing enterprise. With a robust background in knowledge engineering and structure, Javier is enthusiastic about leveraging knowledge to drive enterprise outcomes and enhance buyer expertise.
As corporations more and more depend on knowledge to drive decision-making throughout all industries, HP’s 3D Print division is main the cost with a transformative initiative: sharing close to real-time gear telemetry knowledge with their clients that use 3D Printers as a part of their very own manufacturing course of. This knowledge sharing functionality permits HP’s clients to watch the efficiency and utilization of their leased gear and proactively take enterprise or upkeep actions utilizing knowledge insights. Through the use of Delta Sharing and different Databricks options like Unity Catalog, Mosiac AI and AI/BI dashboards, HP has constructed a safe and scalable answer that gives complete insights into machine efficiency, materials utilization, and upkeep wants.
Empowering clients with knowledge
HP is dedicated to offering its clients with detailed, actionable insights into their gear. This initiative permits clients to view and analyze their printers’ telemetry knowledge, making it doable to optimize their operations, scale back downtime, and acquire a transparent understanding of useful resource utilization to scale back prices.
Led by Javier Lagares – principal knowledge engineer, HP carried out a complete knowledge answer on the Databricks Information Intelligence Platform. This answer captures telemetry knowledge from an array of sensors embedded in HP’s gear, and combines it with knowledge from a number of different gadgets together with not solely printers, but additionally processing stations (which deal with duties that put together a 3D printed object for its last use), unpacking stations (which unpack components, take away powder, and recycles supplies post-3D printing), curing stations (which harden and stabilize components after printing), amongst others. These sensors accumulate essential data for every processing station, akin to the roles processed and supplies used within the jobs, amongst a number of different knowledge factors. This knowledge primarily types the “DNA” of every printer, permitting HP and its clients to realize invaluable insights into the whole print job lifecycle.
Architecting the Answer with Databricks
HP’s answer is constructed on Databricks’ medallion structure, which is designed to allow scalable knowledge ingestion, transformation, and sharing; and consists of 4 foremost phases:
- Touchdown Layer: The touchdown layer serves as a communication layer with the gadgets. The information on this layer is processed precisely as soon as. If knowledge from this layer is just not acknowledged as acquired by HP, a preemptive course of kicks in to cease associated gadgets.
- Bronze Layer: The bronze layer unpacks the data from the touchdown layer into a number of tables for additional consumption.
- Silver Layer: On this stage, the uncooked telemetry knowledge is cleansed, filtered, and remodeled for usability. The information is ready by making use of transformations to take away redundancies, appropriate anomalies, and format it right into a extra usable construction.
- Gold Layer: The Gold layer gives the curated datasets, that are then shared with HP’s clients by way of Delta Sharing, enabling them to research and make the most of this high-value knowledge instantly.
The medallion structure permits HP to course of and share telemetry knowledge making certain that clients at all times have up-to-date data at their disposal.
Sharing Information Securely with Delta Sharing
As soon as the telemetry knowledge has been processed, HP shares it with clients utilizing Databricks’ Delta Sharing open sharing capabilities (D2O). These options permit HP’s clients to eat the information; no matter whether or not they use Databricks or not. The recipients can instantly hook up with shared knowledge utilizing Delta Sharing connectors that help varied programs like pandas, Tableau, Energy BI, Apache Spark, Rust, or others that help the open protocol. When a buyer is registered, they obtain an HP endpoint, which they will use to entry datasets utilizing any Delta Sharing connectors or APIs.
To make the method seamless for patrons, HP supplies complete documentation for every knowledge asset, detailing learn how to eat the information. HP additionally consists of pattern code that leverages D2O libraries to assist clients rapidly combine the information into their pipelines, in addition to a pre-built PowerBI dashboard that reads knowledge by the Delta Sharing connector and clients can use if they like to not create their very own visualizations. This degree of help ensures that HP’s clients can simply start utilizing and analyzing their telemetry knowledge with none prior experience in Delta Sharing or the underlying knowledge structure.
Predictive Upkeep by Mosaic AI
One of the crucial impactful options of HP’s answer is the inclusion of predictive upkeep alerts. Utilizing machine studying fashions that leverage Mosaic AI capabilities, HP can precisely predict upkeep wants based mostly on telemetry knowledge. These predictive upkeep alerts are supplied to HP’s Buyer help to assist them present a greater buyer expertise by reaching out to clients to schedule gear servicing making certain their printers stay in optimum working situation.
These machine studying fashions analyze telemetry knowledge patterns, which might point out early indicators of potential points. By offering these alerts, HP enhances buyer satisfaction by permitting clients to plan forward and scale back interruptions to their manufacturing processes.
Enhanced Information Safety with Unity Catalog and ApiGee
With buyer knowledge privateness and knowledge safety being prime priorities, HP leverages Unity Catalog to implement knowledge governance and apply buyer segmentation. Unity Catalog permits HP to manage entry to knowledge property at a granular degree, permitting them to segregate knowledge for every buyer and apply customized knowledge entry insurance policies based mostly on particular contract phrases. This dynamic mannequin ensures that every buyer solely has entry to their very own knowledge.
Moreover, HP has carried out ApiGee to additional improve knowledge safety. ApiGee acts as a masking layer for all HP inside URLs, making the data-sharing course of 100% clear to clients. Using ApiGee ensures that clients solely work together with safe endpoints, adhering to HP’s knowledge safety framework.
Monitoring and Enhancing Buyer Expertise with AI/BI Dashboards
HP additionally leverages Databricks AI/BI dashboards to watch the utilization of its telemetry answer. These dashboards present metrics on knowledge entry frequency, geographic location, and the variety of customers accessing the information, amongst different attention-grabbing knowledge factors, giving HP’s staff a complete view of how their answer is definitely used.
This utilization knowledge permits HP to know buyer consumption patterns and determine areas for enchancment. For instance, if HP notices a selected characteristic that’s ceaselessly accessed, they may prioritize enhancements to that characteristic in future product iterations. Moreover, the AI/BI dashboards provide insights into geographic tendencies, enabling HP to tailor their help and repair choices to satisfy regional buyer wants.
Conclusion
The flexibility to entry and analyze telemetry knowledge in close to real-time is a game-changer for 3D printing. HP’s answer not solely gives invaluable insights into machine efficiency and the 3D half era course of but additionally permits clients to take a proactive strategy to gear upkeep, maximizing the worth of their leased 3D printers. By persevering with to put money into superior data-sharing applied sciences, HP is setting the usual for data-driven innovation within the 3D printing trade.
As HP continues to refine and increase its data-sharing capabilities, they’re a transparent chief in a future the place knowledge insights turn out to be integral to industrial processes and buyer engagement. With every new enhancement, HP demonstrates its dedication to leveraging expertise for buyer empowerment, setting a excessive bar for knowledge sharing and machine monitoring.
