How to repair a dataset in Amorphic

User can repair the dataset using the ‘Dataset Repair’ button in the dataset details page and following issues can be repaired during the action:
  • AccessRequests: If there are any inconsistency with access requests for the dataset like orphan access requests even if the dataset is deleted, access request approved by another owner etc.
  • DatasetLoads: Deals with the dataset file load failures and updates the status to a safe relevant state.
  • MissingFiles: Compares the dataset files in S3 and also metadata in Dynamo and deletes the irrelevant/orphan files in S3 and updates the DynamoDB.

The following picture depicts how to repair a dataset:

Repair dataset