kql – How to cache external SQL table data in Azure Data Explorer?
I’m using Azure Data Explorer (Kusto) and have an external table that reads data from an external SQL Server using create external table ... kind=sql.
According to the documentation:
👉 Query results cache in Azure Data Explorer
“The query accesses an external table or external data… such queries won’t be cached.”
So the built-in query results cache doesn’t apply to external tables, which means every query triggers a live request to the SQL source.
❓ Question
How can I cache or temporarily store data from an external table inside Azure Data Explorer
to avoid repeated calls to the external SQL source and improve query performance?
Ideally, I’d like to have short-term caching (for example, 1–5 minutes)
fully managed within ADX — without relying on external schedulers or Fabric pipelines.
Is there any Kusto-native mechanism or best practice to cache results of external tables,
or is periodic ingestion into a local table the only option?
Read more here: Source link
