#data engineering
Data Engineering: 3 AI articles covering data engineering news, analysis, and research
Articles
How to Encrypt PII in Data Pipelines While Keeping It Searchableβ10
Learn how to encrypt PII like SSNs in data pipelines while keeping it searchable using deterministic encryption, key derivation, and tokenization.
My Model Worked Perfectly. Then I Tried to Make It Useful.β10
A data analyst builds a churn model that works perfectly but isn't usableβhere's why deploying it for real-world impact matters.
Avoiding Entity Key Drift in a Data Lake: Step 2, When Fuzzyβ9
Fuzzy matching breaks down with Damerau-Levenshtein when distinct product IDs like hdc1008 and hdc1080 score equal to typos, risking entity key drift in data la...
