Amazon Fast Sight<\/a><\/span>\u00a0is a core characteristic inside\u00a0 Amazon Fast<\/a><\/span>\u00a0\u2014 an agentic, AI-powered digital workspace designed to maximise end-user productiveness\u2014 that gives AI-powered BI capabilities by means of pure language queries, interactive dashboards, and embedded analytics from trusted enterprise information sources.<\/p>\n

Amazon Fast Sight property resembling dashboards, analyses, datasets, and information sources could be backed up utilizing the AssetsAsBundle<\/code> APIs described on this submit. A backup technique helps defend towards unintentional deletions, unintended modifications, and regional disruptions. For groups that depend on Fast Sight to assist vital enterprise choices, a well-designed backup plan is really useful.<\/p>\n

This submit is the primary in a two-part sequence masking backup and restore for Amazon Fast Sight BI property:<\/p>\n

\nHalf 1 (this submit):<\/strong> Covers tips on how to design and implement a backup technique, together with asset choice, the APIs out there for export, and a ready-to-use pattern automation software.<\/li>\n

Half 2:<\/strong> Covers the restore course of. You need to use the backups created in Half 1 to recuperate property after unintentional deletion, unintended modifications, or as a part of a broader catastrophe restoration plan.<\/li>\n<\/ul>\nAn efficient backup technique is particularly vital for organizations in closely regulated industries resembling monetary companies, healthcare, and power, for a number of causes:<\/p>\n\nInformation loss prevention<\/strong> protects towards human errors, unintentional deletions, and occasions like ransomware.<\/li>\n
Assembly restoration aims<\/strong> helps organizations obtain their Restoration Level Goals (RPO) and Restoration Time Goals (RTO), minimizing information loss throughout incidents.<\/li>\n
Audit and reporting<\/strong> helps monitoring and reporting on property all through their lifecycle (creation, updates, and deletion).<\/li>\nElevated workload resiliency<\/strong> permits fast restoration of methods to earlier states, decreasing downtime and enhancing reliability. This aligns with the Reliability pillar of the AWS Nicely-Architected Framework<\/a>.<\/li>\n
Catastrophe restoration (DR) preparedness<\/strong> offers a basis for implementing a DR course of<\/a> that anticipates technology-related disasters and contributes to your group\u2019s enterprise continuity plan (BCP)<\/a>.<\/li>\n<\/ul>\nFor extra details about the catastrophe restoration capabilities of Fast, and tips on how to assess them towards organizational necessities, see the Amazon Fast catastrophe restoration and resiliency information<\/a>.<\/p>\n
On this submit, we cowl greatest practices for implementing an efficient backup technique for BI property in Fast Sight. We begin by masking the choices for choosing the property to incorporate in your backup, then clarify the high-level APIs out there for that goal, and finalize with pattern code that will help you get began rapidly.<\/p>\n
Backup practices for enterprise intelligence<\/h2>\nBI methods current distinctive enterprise continuity challenges due to their function in supporting decision-making processes and key stakeholders. You will need to defend them towards service disruptions by implementing an efficient backup plan. Earlier than constructing this plan, it\u2019s essential to grasp the structure and the scale to think about as a part of your DR plan.<\/p>\n
<\/p>\nThe previous diagram reveals that Fast Sight depends on AWS\u2019s international infrastructure throughout a number of AWS Areas to present excessive availability<\/a> for Fast Sight property, together with information sources, datasets, analyses, and dashboards.<\/p>\n
The Tremendous-fast, Parallel, In-memory Calculation Engine (SPICE) shops and encrypts<\/a> imported information with excessive availability (HA) by means of redundant copies throughout a number of Availability Zones (AZs) inside the Fast Sight Area.<\/p>\n
With this regional design, you may keep assets in a number of Areas and use a secondary Area within the unlikely occasion of a regional outage affecting your major BI assets.<\/p>\n
For consumer and id administration<\/em>, Fast Sight makes use of a single Area that you just outline throughout the preliminary account subscription course of<\/a>. The diagram reveals that this Area hosts consumer and group id info and have to be out there for customers to entry Fast Sight.<\/p>\n
For instance, if a consumer needs to entry a dashboard within the eu-west-1 Area however the Fast Sight principal Area is us-east-1, each Areas have to be out there to complete the consumer entry stream. Fast Sight makes use of regional structure with AZs for redundancy. Nevertheless, if what you are promoting wants safety towards the unlikely occasion of a regional outage, you have to design your catastrophe restoration (DR) technique accordingly.<\/p>\n
Tip:<\/strong> If you happen to\u2019re uncertain of your Fast Sight principal Area, you may retrieve this info by operating the next command:<\/p>\n
\naws quicksight describe-account-settings --aws-account-id XXXXXXXXXXXX --region us-east-1<\/code><\/pre>\n<\/p><\/div>\nObserve:<\/strong> This aws quicksight describe-account-settings<\/code> command specifies us-east-1 because the endpoint Area. If you happen to obtain a 200<\/code> standing, your id Area is us-east-1. In any other case, you obtain an error like the next, which instructs you to level to your present id Area (for instance, eu-west-1):<\/p>\n\nAn error occurred (AccessDeniedException) when calling the DescribeAccountSettings operation: Operation is being known as from endpoint us-east-1, however your id area is us-east-1. Please use the eu-west-1 endpoint.<\/code><\/pre>\n<\/p><\/div>\nDefining Fast Sight property to incorporate within the backup plan<\/h2>\nWith a clearer understanding of Fast Sight structure, the subsequent step is choosing the property to incorporate in your backup plan, for this you may observe two methods:<\/p>\nAgain up particular property:<\/strong><\/h3>\nThis selection is appropriate if you outline a backup or DR technique<\/a> centered on defending vital property for what you are promoting operations that you would be able to conveniently restore after a catastrophe or unintentional deletion. This contains particular dashboards (and their dependent property) that key stakeholders use to make enterprise choices or that working groups (finance, logistics, procurement, and so forth) use to assist continued enterprise operation.<\/p>\n
This selection is really useful if you require a simple backup plan and when the BI property which are key to enterprise continuity are a subset of all of the property out there in your Fast Sight occasion.<\/p>\n
Again up all property:<\/strong><\/h3>\nThis technique is really useful if you need to outline a backup technique that covers each versioning and potential catastrophe restoration. By backing up all property, you may carry out in-place rollback of any asset to a earlier state if a human error causes an unintended modification or deletion. Moreover, as a result of you could have a backup of all property in your account, you may choose particular property to revive as a part of your DR plan.<\/p>\n
This strategy provides you most protection but additionally requires extra complicated orchestration and automation. This submit focuses on this technique and offers pattern code that you would be able to adapt to reduce time to manufacturing.<\/p>\n
After you choose your technique, select the kind of BI property to export. Fast Sight presents the next asset varieties:<\/p>\n\nDashboards<\/a>: Learn-only property focused at reader customers, revealed from an evaluation. You may also save a dashboard to an evaluation to make edits.<\/li>\n
Analyses and dashboards<\/a>: An evaluation is an editable model of a dashboard. Solely the authors you select can entry it.<\/li>\n
Information sources<\/a>: An information supply implements the connection to your information, which may come from analytic sources resembling databases or information warehouses, AWS companies resembling Amazon Easy Storage Service (Amazon S3), or third-party software program as a service (SaaS) information suppliers resembling Jira and ServiceNow.<\/li>\n
Datasets<\/a>: An asset sort that makes use of an information supply to entry exterior information that you need to use to organize and construction the information that powers your analyses and dashboards.<\/li>\n
VPC connections<\/a>: A characteristic that you need to use to combine together with your VPC assets resembling databases and information warehouses which are positioned in that VPC or reachable from it (peered VPCs or networks linked by means of VPN or AWS Direct Join).<\/li>\n
Themes<\/a>: A set of styling and look settings that you would be able to apply to a number of analyses and dashboards to match an aesthetic customary that meets your product or company branding wants.<\/li>\n<\/ul>\nAll these property have dependencies between one another, with analyses and dashboards on the prime of this dependency chain, as the next diagram illustrates.<\/p>\n
<\/p>\n
If you select the asset varieties to again up, concentrate on these dependencies so you may absolutely restore property from the backup. For instance, if you again up a dashboard, you additionally have to again up its dependencies, which could embrace datasets, information sources, VPC connections, and a theme. The subsequent sections clarify how Fast Sight export APIs deal with these dependencies.<\/p>\nBackup course of overview<\/h2>\nThe mechanism we cowl on this submit makes use of the AssetsAsBundle APIs<\/a> out there in Fast Sight. AssetsAsBundle APIs (additionally referenced as AAB APIs) are a set of high-level APIs designed to assist programmatic export and import of Fast Sight assets. They cowl a variety of use instances resembling launch administration, backup and restore, cross-account migration, and steady integration and steady supply (CI\/CD) workflows<\/a>.<\/p>\n
This set of APIs contains the next operations:<\/p>\n
\nStartAssetBundleExportJob<\/a>: Creates a bundle (bundle) that comprises the property exported as a part of the operation. The bundle is a zipper file with textual content recordsdata. The format could be both JSON or AWS CloudFormation<\/a> relying on the worth specified within the ExportFormat<\/a> parameter. Relying on the format, you may import these property utilizing the AAB APIs immediately or use CloudFormation infrastructure as code (IaC) for provisioning. After the asynchronous operation finishes, the system uploads the bundle to a short lived S3 location for downloading.<\/li>\n
StartAssetBundleImportJob<\/a>: Takes a beforehand exported bundle and restores the property packed in it. You need to use the import operation to outline overrides for a large<\/a> set of parameters resembling asset names and information supply connection parameters (host, port, workgroup, and extra).<\/li>\n
DescribeAssetBundleImportJob<\/a> and DescribeAssetBundleExportJob<\/a>: Each AssetBundle operations are asynchronous. You need to use these APIs to explain the operation, ballot for its standing, and act after it finishes. If you carry out an export job, you need to use DescribeAssetBundleExportJob<\/code> to retrieve the DownloadUrl<\/code> for the bundle, which is legitimate for five minutes. You may renew the URL with additional calls to DescribeAssetBundleExportJob<\/code>.<\/li>\n<\/ul>\nSupported property and present limitations of AssetsAsBundle APIs<\/h3>\nAssetsAsBundle APIs assist a listing of Fast Sight property together with analyses, dashboards, information sources, datasets, shared folders, restricted folders, refresh schedules, themes, and VPC connections. Nevertheless, some asset varieties have limitations.<\/p>\nUnsupported information sources:<\/strong> Adobe Analytics, File, GitHub, Jira, Salesforce, ServiceNow, Amazon S3 (with regionally uploaded manifest recordsdata<\/a>), and Twitter.<\/p>\n
Unsupported datasets:<\/strong> Datasets that comprise machine studying (ML) columns generated utilizing inference by means of linked SageMaker ML fashions<\/a>.<\/p>\n
You will need to exclude these property out of your backup plan to keep away from an InvalidParameterValueException<\/code> error if you concern the StartAssetBundleExportJob<\/code> operation.<\/p>\n
To work round this, you may substitute unsupported information sources and datasets by following these procedures.<\/p>\n
For Amazon S3 information sources with native manifest recordsdata:<\/strong><\/p>\n
\nCreate a brand new Amazon S3 information supply.<\/li>\n
Add the manifest file to Amazon S3.<\/li>\n
Reference the manifest file out of your information supply.<\/li>\nSubstitute the information supply within the dependent datasets utilizing the UpdateDataSet<\/a> API.<\/li>\n<\/ol>\nFor different unsupported information sources and datasets:<\/strong><\/p>\n
Observe this process to rework your incompatible dataset right into a suitable one:<\/p>\n\nCreate an evaluation linked to the information supply you need to assist in your backup.<\/li>\nCreate a desk visible<\/a> that shows all dataset columns.<\/li>\n
Export the information as a CSV file.<\/li>\n
Create an Amazon S3 dataset utilizing a manifest uploaded to Amazon S3.<\/li>\n
Replace your analyses and dashboards with the brand new dataset utilizing the substitute dataset performance<\/a>.<\/li>\n<\/ol>\nDifferent property to think about as a part of your backup<\/h3>\nThough Fast Sight assets are the important thing property to again up, you’ll want to embrace some extra assets and configurations in your backup plan for potential restore or catastrophe restoration conditions.<\/p>\nYou may export Fast Sight property together with their permissions, together with the customers and teams which have entry to them. You management this by setting the IncludePermissions<\/a> flag to true<\/code>.<\/p>\n
As a result of every Fast Sight asset is owned by a consumer, you’ll want to again up customers and teams to have a full and restorable backup.<\/p>\n
AssetsAsBundle APIs don\u2019t cowl customers and teams, however you need to use DescribeUser<\/a>, DescribeGroup<\/a>, and DescribeGroupMembership<\/a> to incorporate this info within the backup.<\/p>\n
Along with customers and teams, think about backing up account settings resembling account customization (the DescribeAccountCustomization<\/a> API), personalized manufacturers (the DescribeBrand<\/a> API), and folders (the ListFolders<\/a>, DescribeFolder<\/a>, and DescribeFolderPermissions<\/a> APIs).<\/p>\n
Technical implementation<\/h2>\nOn this part, we cowl tips on how to create an automation that orchestrates the invocation of the Fast Sight APIs wanted to carry out an efficient backup implementation. We offer pattern code on the finish of this part that implements each customers and teams backup and Fast Sight property backup.<\/p>\n
Backup orchestration stream<\/h3>\nThe automation software helps three modes of operation: consumer backup solely, property backup solely, and each. This offers most flexibility if you carry out your backup plan. The next diagram reveals the stream that the software follows relying on the chosen operation mode.<\/p>\n
<\/p>\nCustomers and group backup<\/h3>\nThe consumer and teams backup service makes use of the Fast Sight consumer<\/a> and group<\/a> APIs to learn your account\u2019s present state and retailer the retrieved consumer and group information in Amazon DynamoDB<\/a>. The service makes use of date-based suffixes for DynamoDB desk names to protect historic backup information and stop overwrites. This permits point-in-time restoration and backup historical past monitoring. This design additionally simplifies restore operations since you don\u2019t have to filter by date suffixes if you question information inside a particular backup.<\/p>\n
<\/p>\n
Instance for a backup run on 2025-10-19:<\/strong><\/p>\n
\nCustomers<\/strong>: quicksight-users-backup-2025-10-19<\/li>\n
Teams<\/strong>: quicksight-groups-backup-2025-10-19<\/li>\nPerson-Group Memberships<\/strong>: quicksight-users-groups-backup-2025-10-19<\/li>\n<\/ul>\nCustomers Desk Schema:<\/strong><\/p>\n\n{\n  \"user_name\": \"string (partition key)\",\n  \"arn\": \"string\",\n  \"e-mail\": \"string\",\n  \"function\": \"string\",\n  \"identity_type\": \"string\",\n  \"lively\": \"boolean\",\n  \"principal_id\": \"string\",\n  \"backup_timestamp\": \"string (ISO 8601)\",\n  \"custom_permissions_name\": \"string\"\n}<\/code><\/pre>\n<\/p><\/div>\nTeams Desk Schema:<\/strong><\/p>\n\n{\n  \"group_name\": \"string (partition key)\",\n  \"arn\": \"string\",\n  \"description\": \"string\",\n  \"principal_id\": \"string\",\n  \"members\": [\"list of user names\"],\n  \"backup_timestamp\": \"string (ISO 8601)\"\n}<\/code><\/pre>\n<\/p><\/div>\nCustomers-Teams Membership Desk Schema:<\/strong><\/p>\n\n{\n  \"membership_id\": \"string (partition key, format: username#groupname)\",\n  \"user_name\": \"string\",\n  \"group_name\": \"string\",\n  \"user_arn\": \"string\",\n  \"group_arn\": \"string\",\n  \"backup_timestamp\": \"string (ISO 8601)\"\n}<\/code><\/pre>\n<\/p><\/div>\nObserve:<\/strong> The consumer and group backup service implements dual-Area assist. Person and group operations use the identity_region<\/code> configuration parameter, whereas backup asset operations use the usual aws_region<\/code>. This design addresses enterprise situations the place Fast Sight id administration is configured in a distinct Area than asset storage.<\/p>\nProperty backup<\/h3>\nThe property bundle backup service coordinates the export of property inside a Area and uploads the generated bundle to an Amazon S3 location for later use. The automation backs up the next property: information sources, datasets, analyses, dashboards, and themes. By default, the backup contains all dependencies. You may disable this setting if wanted.<\/p>\n
At a excessive stage, the service performs the next duties:<\/p>\n
\nLists all information sources utilizing the ListDataSources<\/a> API, filtering out Amazon S3 manifest-based information sources and information sources with invalid VPC connection names. Names should comprise solely alphanumeric characters separated by hyphens.<\/li>\n
Lists all datasets utilizing the ListDataSets<\/a> API, filtering out FILE<\/code> datasets by checking the ImportMode<\/code> area.<\/li>\n
Lists all analyses utilizing the ListAnalyses<\/a> API.<\/li>\n
Lists all dashboards utilizing the ListDashboards<\/a> API.<\/li>\n
Teams property by sort for separate export jobs. You may configure the variety of property to incorporate in every bundle, with a most of 100 (the API restrict<\/a>).<\/li>\n
Checks the export job standing utilizing the DescribeAssetBundleExportJob<\/a> API and implements exponential backoff<\/a> to keep away from throttling.<\/li>\n
Uploads the finished asset bundle to Amazon S3 utilizing the next prefix construction.<\/li>\n<\/ul>\n\nmy-QuickSight-backups\/\n\u2514\u2500\u2500 QuickSight-backups\/                          # Customized S3 prefix\n    \u251c\u2500\u2500 2024\/01\/15\/\n    \u2502   \u251c\u2500\u2500 datasources\/\n    \u2502   \u2502   \u251c\u2500\u2500 datasources-143022.zip            # Single bundle (\u2264 max_assets_per_bundle)\n    \u2502   \u2502   \u2514\u2500\u2500 datasources_bundle_1-143045.zip   # A number of bundles when property exceed restrict\n    \u2502   \u251c\u2500\u2500 datasets\/\n    \u2502   \u2502   \u251c\u2500\u2500 datasets_bundle_1-143045.zip      # A number of bundles when property exceed restrict\n    \u2502   \u2502   \u2514\u2500\u2500 datasets_bundle_2-143045.zip      # Sequential numbering for a number of bundles\n    \u2502   \u251c\u2500\u2500 analyses\/\n    \u2502   \u2502   \u2514\u2500\u2500 analyses-143108.zip               # Single bundle\n    \u2502   \u2514\u2500\u2500 dashboards\/\n    \u2502       \u251c\u2500\u2500 dashboards_bundle_1-143131.zip    # First of a number of dashboard bundles\n    \u2502       \u2514\u2500\u2500 dashboards_bundle_2-143131.zip    # Second dashboard bundle\n    \u2514\u2500\u2500 2024\/01\/16\/\n        \u251c\u2500\u2500 datasources\/\n        \u2502   \u2514\u2500\u2500 datasources-090015.zip\n        \u251c\u2500\u2500 datasets\/\n        \u2502   \u2514\u2500\u2500 datasets-090030.zip\n        \u2514\u2500\u2500 ...<\/code><\/pre>\n<\/p><\/div>\nObserve:<\/strong> The bundle quantity string is current solely when the variety of property to again up exceeds the configured worth in max_assets_per_bundle<\/code>.<\/p>\nFinish-to-end software for backup creation<\/h3>\nThe QuickSight-backup software offers a easy technique to export all of your Fast Sight property and their dependencies into sturdy, cheap storage resembling Amazon S3. The software creates new prefixes for generated bundles, so earlier backups aren\u2019t overwritten. The software additionally exports customers and teams utilizing the identical precept: DynamoDB shops this information, and desk names comprise the date when the backup was generated. With this strategy, you need to use backups as a supply to your restoration technique and observe the historical past of modifications to your Fast Sight property and related customers.<\/p>\nThe code makes use of the Boto3 Python SDK<\/a> and contains packaging assist by means of setuptools<\/a> for setup and use.<\/p>\n
Tooling utilization and configuration<\/h3>\nEarlier than utilizing the software, be sure you meet the next conditions:<\/p>\n\nPython 3.8 or larger.<\/li>\n
A Fast Sight account with Enterprise version or larger.<\/li>\n
AWS Command Line Interface (AWS CLI) configured with applicable credentials.<\/li>\nRequired AWS permissions. See the Permissions part<\/a> within the code.<\/li>\n<\/ul>\nClone from supply<\/strong><\/p>\n\ngit clone https:\/\/github.com\/aws-samples\/sample-quicksight-backup-tool.git\ncd quicksight-backup-tool<\/code><\/pre>\n<\/p><\/div>\nCreate a Python venv (really useful)<\/strong><\/p>\n\npython3 -m venv .\/.venv\nsupply .venv\/bin\/activate<\/code><\/pre>\n<\/p><\/div>\nSet up the bundle<\/strong><\/p>\n
Create a configuration file<\/strong><\/p>\nTo get began, consult with the config-basic.yaml<\/a> file within the repo or create one from scratch. This configuration file defines key parameters for the software, together with the next:<\/p>\n
\nAWS account.<\/li>\n
Area.<\/li>\nBackup places (DynamoDB tables and Amazon S3 bucket prefixes).<\/li>\n<\/ul>\nUtilizing the software<\/strong><\/p>\n
After set up, you may run the software as follows:<\/p>\n\nquicksight-backup --config config.yaml --mode full<\/code><\/pre>\n<\/p><\/div>\nYou solely want to offer the --config<\/code> parameter. You may omit the remaining. The --mode<\/code> parameter controls the backup sort (full<\/code>, users-only<\/code>, or assets-only<\/code>), the place full<\/code> is the default mode. The next record describes the arguments the software helps.<\/p>\n
Non-compulsory arguments<\/strong><\/p>\n\n--mode<\/code>, -m<\/code>: Backup mode (full<\/code>, users-only<\/code>, assets-only<\/code>); default is full<\/code>.<\/li>\n
--output-dir<\/code>, -o<\/code>: Output listing for experiences and manifests.<\/li>\n
--verbose<\/code>, -v<\/code>: Allow verbose (DEBUG<\/code>) logging.<\/li>\n
--log-file<\/code>: Path to log file.<\/li>\n
--dry-run<\/code>: Validate configuration with out operating the backup.<\/li>\n
--no-progress<\/code>: Disable progress indicators.<\/li>\n
--generate-manifest<\/code>: Generate a backup manifest file.<\/li>\n
--generate-report<\/code>: Generate a human-readable backup report.<\/li>\n--version<\/code>: Present model info.<\/li>\n<\/ul>\nFor extra info, see the software README file<\/a>.<\/p>\n
Device code<\/h3>\nYow will discover the code for this software within the aws-samples repository<\/a>. This software helps you get began rapidly. Use it as a foundational reference to refine and adapt to your particular backup necessities.<\/p>\n
Earlier than you implement a backup resolution in your manufacturing setting, verify that you just:<\/p>\n
\nAssessment and adapt the code<\/strong> to align together with your particular infrastructure necessities, safety insurance policies, and compliance requirements.<\/li>\n
Conduct thorough testing<\/strong> in a non-production setting to validate performance and efficiency.<\/li>\n
Implement applicable safety controls<\/strong> together with encryption, entry administration, and audit logging required by your group.<\/li>\n
Validate restoration procedures<\/strong> to verify your backup technique meets your outlined Restoration Time Goals (RTO) and Restoration Level Goals (RPO).<\/li>\n
Contemplate price optimization<\/strong> methods and monitoring to maintain the answer inside your operational funds.<\/li>\nKeep away from concurrent software execution:<\/strong> This software depends on the AssetsAsBundle APIs, which have low throttling thresholds. The pattern software shouldn’t be designed to run a number of situations in parallel inside the identical AWS account. If a number of groups want to make use of the software, think about implementing a concurrency management mechanism (for instance, a lock desk in DynamoDB or a database-level lock) to stop concurrent runs that might set off API throttling.<\/li>\n<\/ul>\nScheduled execution<\/h2>\nThe pattern software described within the earlier part is designed for on-demand execution and is effectively fitted to getting began or operating ad-hoc backups. For a production-grade backup technique, you would possibly need to automate backup runs on a recurring schedule in order that your Fast Sight property are persistently protected with out guide intervention.<\/p>\n
This part outlines the high-level structure for a scheduled, absolutely automated backup resolution. Detailed implementation and code for this structure are exterior the scope of this submit.<\/p>\nStructure overview<\/h3>\nThe scheduled execution structure is constructed on three AWS managed companies that work collectively to offer a dependable, serverless, and cost-effective automation pipeline:<\/p>\n\nAmazon EventBridge<\/a> is the scheduler. It triggers the backup workflow at an outlined cadence, for instance, day by day at midnight. EventBridge guidelines allow you to outline versatile cron-based or rate-based schedules with out managing any underlying infrastructure.<\/li>\n
AWS Step Capabilities<\/a> is the orchestration layer. It coordinates the run of the person backup steps within the right sequence. Step Capabilities offers built-in error dealing with, retry logic, and execution historical past, which makes it effectively fitted to long-running workflows that span a number of API calls and asynchronous operations.<\/li>\n
AWS Lambda<\/a> implements every particular person backup step as an unbiased, stateless operate. Splitting the backup logic throughout a number of Lambda features addresses the time constraints inherent within the backup course of. Every export job is asynchronous and would possibly take a number of minutes to complete, relying on the quantity and measurement of property being exported.<\/li>\n<\/ul>\nWorkflow steps<\/h3>\nAs a result of the end-to-end backup course of can take a major period of time, the automation is decomposed into discrete steps, every carried out by a devoted Lambda operate. AWS Step Capabilities orchestrates these features in sequence, passing state between them and dealing with retries for transient failures. The workflow consists of the next steps:<\/p>\n\nCustomers and teams backup:<\/strong> Retrieves all Fast Sight customers, teams, and group memberships utilizing the Fast Sight id APIs and persists the information to DynamoDB with date-based desk suffixes, as described within the Technical implementation<\/em> part. This operation can run in parallel with the asset backup operations as a result of it doesn\u2019t have any dependency.<\/li>\n
Asset backup discovery:<\/strong> Lists all Fast Sight property within the goal Area (information sources, datasets, analyses, and dashboards), applies the required filters to exclude unsupported asset varieties, and teams property into lists of as much as 100 objects every. The output of this step is handed to subsequent steps as enter.<\/li>\n
Generate bundle:<\/strong> Initiates export jobs for all of the property included within the record specified because the enter parameter, polls for job completion, and uploads the ensuing ZIP bundles to the designated Amazon S3 prefix.<\/li>\nExamine standing:<\/strong> Periodically polls the lively bundle execution and notifies the AWS Step Capabilities state machine when the export finishes.<\/li>\n<\/ol>\nThe next diagram illustrates the high-level stream of the scheduled execution structure.<\/p>\n
<\/p>\nKey design concerns<\/h3>\n\nAsynchronous polling:<\/strong> The check-status Lambda operate polls the job initiated by the generate-bundle Lambda operate utilizing the DescribeAssetBundleExportJob<\/code> API till the job reaches a terminal state (SUCCESSFUL<\/code> or FAILED<\/code>). The check-status Lambda operate runs in a loop with a ready situation (for instance, 30 seconds) between calls.<\/li>\nParallelism:<\/strong> Configure an satisfactory stage of parallelism to regulate the amount of API calls carried out by the steps in your workflow, particularly on the generate-bundle step that calls the DescribeAssetBundleExportJob<\/code> and StartAssetBundleExportJob<\/code> APIs, which have low concurrent price limits. You need to use the inline map state MaxConcurrency area<\/a> to restrict the variety of concurrent runs of the generate-bundle step.<\/li>\n
Error dealing with:<\/strong> Step Capabilities permits you to outline catch blocks and retry insurance policies at every stage. A failure in a single step (for instance, an unsupported asset sort) doesn\u2019t abort your complete backup run.<\/li>\n
Value:<\/strong> When scheduling is enabled, prices scale with backup frequency and retention interval. For steering on estimating storage prices, see the Value estimation<\/em> part.<\/li>\n<\/ul>\nValue estimation<\/h2>\nThe next sections estimate the prices of operating the backup software on Amazon S3 (for asset bundles) and DynamoDB (for consumer and group metadata).<\/p>\n
Amazon S3: asset bundle storage<\/h3>\nAsset bundles are compressed ZIP recordsdata uploaded to Amazon S3 after every export job. Based mostly on the answer design, every bundle of as much as 100 property averages roughly 500 KB when compressed.<\/p>\n
Key takeaway:<\/strong> Amazon S3 storage prices for asset bundles are minimal. Even for very massive Fast Sight deployments with hundreds of property, the compressed bundle measurement stays within the low megabytes vary, leading to a month-to-month storage price effectively under $0.01.<\/p>\nAmazon DynamoDB: consumer and group metadata storage<\/h3>\nPerson and group info is saved in DynamoDB tables with date-based suffixes to protect backup historical past. DynamoDB storage is priced at roughly $0.25 per GB per thirty days (Customary desk class, on-demand mode).<\/p>\n
Every merchandise saved in DynamoDB represents a single consumer or group definition (together with all related attributes resembling ARN, e-mail, function, group memberships, and backup timestamp). Based mostly on the schema described on this submit, the common merchandise measurement is roughly 256 KB.<\/p>\n
You need to use this method to estimate the scale of your DynamoDB tables:<\/p>\n
Desk measurement estimate = Variety of objects \u00d7 Common merchandise measurement (256 KB)<\/strong><\/p>\n
Key takeaway:<\/strong> For small and medium organizations, DynamoDB storage prices stay minimal (below $0.10 per thirty days per backup snapshot). For big organizations with tens of hundreds of customers, prices are nonetheless modest, within the low single-digit greenback vary per snapshot.<\/p>\nAbstract<\/h2>\nFor a single, unscheduled backup run, the whole AWS price is successfully close to zero, dominated by a couple of cents of Amazon S3 and DynamoDB storage at most. If you happen to implement scheduled backups (coated within the Scheduled execution<\/em> part), prices scale linearly with backup frequency and retention interval. Even with day by day backups retained for 90 days, complete storage prices stay within the low single-digit greenback vary for many deployments. Think about using Amazon S3 Lifecycle insurance policies and DynamoDB Customary-IA to optimize prices as your backup historical past grows.<\/p>\nConclusion<\/h2>\nOn this submit, we coated tips on how to design and implement a complete backup technique for Amazon Fast Sight property so you may keep enterprise continuity, meet regulatory necessities, and defend towards information loss.<\/p>\n
We coated tips on how to use AssetsAsBundle APIs to programmatically export and protect vital BI property, together with dashboards, analyses, datasets, and information sources, together with their dependencies and permissions. That will help you get began, this submit features a pattern automation software that you would be able to take a look at and adapt to your group\u2019s wants. The code orchestrates these APIs, shops asset bundles in Amazon S3, and preserves consumer and group info in DynamoDB for point-in-time restoration.<\/p>\nPrepared to guard your Fast Sight BI property? Get began at this time by cloning the pattern backup software from the AWS Samples repository<\/a> and testing it in your non-production setting. Start with a easy configuration to again up your most crucial dashboards, then broaden to a production-ready backup technique as you validate the method. To be taught extra about Amazon Fast Sight, see the Amazon Fast Sight Person Information<\/a>.<\/p>\n\n
In regards to the writer<\/h2>\n\n\n\n<\/p>\n<\/p><\/div>\n
Enrique Salgado Hernandez<\/h3>\n\nEnrique Salgado Hern\u00e1ndez<\/b>\u00a0is a Senior Specialist Options Architect at AWS with greater than 10 years of expertise working within the cloud. He makes a speciality of designing and implementing large-scale analytics architectures throughout varied business sectors. He’s captivated with working with clients to unravel their issues by supporting them throughout their cloud journey.<\/p>\n<\/blockquote><\/div>\n<\/footer>\n
       \n      <\/div>\n\n","protected":false},"excerpt":{"rendered":"
Amazon Fast Sight\u00a0is a core characteristic inside\u00a0Amazon Fast\u00a0\u2014 an agentic, AI-powered digital workspace designed to maximise end-user productiveness\u2014 that gives AI-powered BI capabilities by means of pure language queries, interactive dashboards, and embedded analytics from trusted enterprise information sources. Amazon Fast Sight property resembling dashboards, analyses, datasets, and information sources could be backed up utilizing […]<\/p>\n","protected":false},"author":2,"featured_media":16248,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[55],"tags":[387,9447,2927,3899,1495,3380,481],"class_list":["post-16246","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-machine-learning","tag-amazon","tag-assets","tag-backup","tag-implement","tag-quick","tag-sight","tag-strategy"],"_links":{"self":[{"href":"https:\/\/techtrendfeed.com\/index.php?rest_route=\/wp\/v2\/posts\/16246","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/techtrendfeed.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/techtrendfeed.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/techtrendfeed.com\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/techtrendfeed.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=16246"}],"version-history":[{"count":1,"href":"https:\/\/techtrendfeed.com\/index.php?rest_route=\/wp\/v2\/posts\/16246\/revisions"}],"predecessor-version":[{"id":16247,"href":"https:\/\/techtrendfeed.com\/index.php?rest_route=\/wp\/v2\/posts\/16246\/revisions\/16247"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/techtrendfeed.com\/index.php?rest_route=\/wp\/v2\/media\/16248"}],"wp:attachment":[{"href":"https:\/\/techtrendfeed.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=16246"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/techtrendfeed.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=16246"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/techtrendfeed.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=16246"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}

Defining Fast Sight property to incorporate within the backup plan<\/h2>\n
With a clearer understanding of Fast Sight structure, the subsequent step is choosing the property to incorporate in your backup plan, for this you may observe two methods:<\/p>\n

Value estimation<\/h2>\n
The next sections estimate the prices of operating the backup software on Amazon S3 (for asset bundles) and DynamoDB (for consumer and group metadata).<\/p>\n