DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Snowflake to Databricks: what the migration actually costs you
zephico profile

Snowflake to Databricks: what the migration actually costs you

#databricks#dataengineering
Comments
5 min read
You Forgot to Mention the 500 Million Rows
raghavsharma_ profile
raghav sharma

You Forgot to Mention the 500 Million Rows

#ai#dataengineering#sql#performance
Comments
4 min read
Mastering Databricks Cost Optimisation Without Slowing Teams
vachkov profile

Mastering Databricks Cost Optimisation Without Slowing Teams

#databricks#finops#dataengineering#cloud
Comments
6 min read
Incremental Graph Updates for Corporate Knowledge Graphs: Three Problems Batch Pipelines Can't Solve
hannune profile
Tae Kim

Incremental Graph Updates for Corporate Knowledge Graphs: Three Problems Batch Pipelines Can't Solve

#graphdatabases#python#llm#dataengineering
Comments
5 min read
Why CTE vs Subquery Matters More on Redshift Than Anywhere Else
maithreyan11 profile
Maithreyan

Why CTE vs Subquery Matters More on Redshift Than Anywhere Else

#redshift#sql#dataengineering#aws
Comments
2 min read
Storix: One Typed Python Filesystem API from Local Development to Cloud Storage
mghalix profile
Mohanad Ghali

Storix: One Typed Python Filesystem API from Local Development to Cloud Storage

#showdev#python#cloud#dataengineering
Comments
16 min read
RAG vs. Semantic Layer: Why AI Needs Deterministic Governance
harshit_colrows profile

RAG vs. Semantic Layer: Why AI Needs Deterministic Governance

#dataengineering#database#ai#datascience
Comments
2 min read
Monitoring Airbyte's Postgres CDC Replication Slots Before They Take Down Your Source Database
mukesh_13 profile
Mukesh

Monitoring Airbyte's Postgres CDC Replication Slots Before They Take Down Your Source Database

#airbyte#postgres#cdc#dataengineering
Comments
5 min read
Building Airbyte Connectors That Survive Flaky APIs: Cursor Checkpointing for Resilient Incremental Sync
mukesh_13 profile
Mukesh

Building Airbyte Connectors That Survive Flaky APIs: Cursor Checkpointing for Resilient Incremental Sync

#airbyte#dataengineering#elt#python
Comments
5 min read
100 城时区页给跨区调度当速查，DST 自动算
caresodev profile
tine

100 城时区页给跨区调度当速查，DST 自动算

#dataengineering#database#python#tutorial
Comments
1 min read
Building an Airbyte Destination Connector That Embeds and Dedupes Records Before They Hit pgvector
mukesh_13 profile
Mukesh

Building an Airbyte Destination Connector That Embeds and Dedupes Records Before They Hit pgvector

#airbyte#dataengineering#pgvector#rag
Comments
4 min read
Stop Faking Your Test Data: Why `Faker.js` Breaks the Moment You Have Foreign Keys
jitendra_devabhaktuni_0f1 profile

Stop Faking Your Test Data: Why `Faker.js` Breaks the Moment You Have Foreign Keys

#api#ai#datascience#dataengineering
Comments
5 min read
How to Run Apache Iceberg & Trino Locally in 60 Seconds (Zero AWS Cost)
ofirnakdai profile

How to Run Apache Iceberg & Trino Locally in 60 Seconds (Zero AWS Cost)

#dataengineering#python#docker#architecture
Comments
2 min read
The Most Underused Prompt in Data Engineering
raghavsharma_ profile
raghav sharma

The Most Underused Prompt in Data Engineering

#ai#productivity#dataengineering#learning
Comments
4 min read
Confident Is Not Correct: Three Signs That Claude Is Guessing
raghavsharma_ profile
raghav sharma

Confident Is Not Correct: Three Signs That Claude Is Guessing

#discuss#ai#dataengineering#programming
Comments
5 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.