News Feed

No results for 'undefined'
Powered by Algolia

Synapse LINK Load streaming DataFrame from Azure Cosmos DB container


Author: AMMISAID

Originally Sourced from: https://stackoverflow.com/questions/64352416/synapse-link-load-streaming-dataframe-from-azure-cosmos-db-container

I am traying to use feed changes on synpase, I am using synapse link to connect to cosmos,

dfStream = spark.readStream\
    .format("cosmos.oltp")\
    .option("spark.synapse.linkedService", "<enter linked service name>")\
    .option("spark.cosmos.container", "<enter container name>")\
    .option("spark.cosmos.changeFeed.readEnabled", "true")\
    .option("spark.cosmos.changeFeed.startFromTheBeginning", "true")\
    .option("spark.cosmos.changeFeed.checkpointLocation", "/localReadCheckpointFolder")\
    .option("spark.cosmos.changeFeed.queryName", "streamQuery")\
    .load()

and i am getting error :

Error : org.apache.hadoop.fs.azurebfs.contracts.exceptions.AbfsRestOperationException: Operation failed: "This request is not authorized to perform this operation using this permission.", 403, DELETE, https://adlsgarage7.dfs.core.windows.net/adlsgarage7/localReadCheckpointFolder/streamQuery?