News and insights
How does storage organisation affect query performance?
Despite great efforts to separate interface from the implementation (like SQL), the pesky details always come up important when deploying to production, either when performance…
check out.
Insights and best practices delivered to your inbox every month.
What if the data is too large for the LLM context?
Navigating Large Data with LLM: Splitting, Context, and Self-Query Solutions
check out.
What Data Format is suitable for LLM?
LLM's Frontier: The Data Format Issue
check out.
Terraform: multiple environments
Why terraform? When one starts a new project, there is a high probability that the project will be placed in the cloud. Having a…
check out.
NPM & N on MacOSX
Most programming languages have their SDK available for non-system-wide installation. Python offers venv, while Java Development Kit needs only the JAVA_HOME variable to be set,…
check out.
Managing inter-DAG dependencies in Airflow
In the real world, data pipelines only sometimes come as a completely independent sequence of operations. Usually, they share dependences on one another, occasionally easy…
check out.
Big cartesian join in Big Query
When working on more advanced analytics (or reports), you may stumble upon the problem of doing a self-join. Be it all pairs of available products,…
check out.