Big Data
Tag6.5K stories
Big data news and engineering for datasets too large for a single machine. Coverage spans distributed storage and compute frameworks, partitioning and file formats, batch against streaming pipelines, cluster cost, and whether the scale is warranted.
Bridging Systems: Tackling the Complexity of Cross-Domain InteroperabilityLanceDB, which counts Midjourney as a customer, is building databases for multimodal AIAmazon EMR 7.1 now supports Trino 435, Python 3.11Using BigQuery Dataplex to build a data meshBuilding Analytical Apps on the Lakehouse using Apache Hudi, Daft & StreamlitExploring Modern Data Integration: Google Pub/Sub, Data Fusion, Dataflow, Data Catalog, Data Pipeline vs. ETLDid You Snow? #1—Snowflake Sequence does not guarantee gap-free numbers. Why?Trendyol uses Looker on top of BigQuery and BigLake data lakeIntroducing the Heroku Postgres Connector for Salesforce Data CloudHarnessing the Power of Language Models to Solve Big Data Challenges
Roadmaps
Comprehensive roadmap for Big Data
By roadmap.sh
