Move data by using client SDK bulk operations

Microsoft Cosmos DB is a fully managed, globally distributed, and multi-model database service offered by Microsoft Azure. It provides seamless scalability and high availability, making it an ideal choice for building data-intensive native applications. In this article, we will explore how to efficiently move data using client SDK bulk operations within Azure Cosmos DB.

Bulk Import Using .NET SDK

The .NET SDK for Azure Cosmos DB provides the BulkExecutor class to facilitate high-throughput bulk import operations. This class offers methods for uploading documents in bulk using parallelization, reducing the overall time required for data migration.

Here’s an example of how you can use the BulkExecutor class for bulk importing using the .NET SDK:

csharp
using Microsoft.Azure.Cosmos;
using Microsoft.Azure.Documents.Client;
using System.Collections.Generic;
using System.Threading.Tasks;

// Create a list of documents to import
IEnumerable

In the above code snippet, we first initialize the CosmosClient with your Cosmos DB connection string. Then we create or get a reference to the desired database and container. Next, we create a list of documents to import.

To configure the bulk import options, we set the EnableUpsert flag to enable upsert behavior (update or insert) and specify the MaxConcurrencyPerPartitionKey value to control the maximum concurrency allowed per partition key.

Finally, we create an instance of BulkExecutor and call the BulkImportAsync method, passing in the list of documents and the import options. This method performs the bulk import operation.

Bulk Update Using Java SDK

Similarly, Azure Cosmos DB provides bulk support for data updates using the Java SDK. The BulkExecutor class in the Java SDK allows efficient bulk execution of update queries.

Here’s an example of how to perform bulk updates using the Java SDK:

java
import com.azure.cosmos.*;
import com.azure.cosmos.models.*;
import com.azure.cosmos.bulkexecutor.*;

// Perform the bulk update operation
BulkUpdateResponse bulkUpdateResponse = bulkExecutorContext.bulkUpdate(
query,
requestOptions,
new BulkUpdateCallback() {
@Override
public void bulkUpdateResponse(BulkUpdateResponse bulkUpdateResponse) {
// Handle the response
}
}
);


In the above code snippet, we first initialize the CosmosClient with the Cosmos DB endpoint and authorization key. Then we create or get a reference to the desired database and container, similar to the .NET SDK example.

Next, we create an instance of BulkExecutor using the builder pattern and provide the CosmosClient and CosmosContainer objects.

We also create a BulkExecutorContext using the BulkExecutor instance, which helps define the bulk operation context.

In this example, we define a query string to select documents for update. We also create UpdateItemRequestOptions to specify the partition key for the update operation.

Finally, we invoke the bulkUpdate method on the BulkExecutorContext instance, passing in the query, request options, and a callback to handle the response.

By utilizing bulk operations provided by the Azure Cosmos DB SDKs, you can efficiently move and update data in your native applications, saving both time and costs. Make sure to refer to the official Microsoft documentation for details on additional features and options available for bulk operations in Azure Cosmos DB.