James's Ramblings

AWS: Storage Gateway

Created: October 08, 2020
  • Access data stored in AWS from on-premise machines.
  • Services that you can use with Storage Gateway include S3, AWS Backup, EBS, and Tape Library.
  • Glacier, Deep Archive, and Tape Archive cannot directly be used with Storage Gateway.
  • Data is encrypted in transit.
  • There are three sub-services: File Gateway, Volume Gateway, and Tape Gateway.
  • Runs as an appliance on a VM or hardware appliance. HVs: ESXi, Hyper-V, KVM, or EC2.

File Gateway

  • SMB or NFS.
  • Allows for a local cache.
  • Files are stored on S3.
  • Available S3 storage classes are: Standard, Standard IA, and One Zone IA.

Volume Gateway

  • Store the volumes of an on-prem server on AWS.

  • ISCI facilitates the communication between the server/s and Volume Gateway.

  • Two possible modes.

  • Cached Volume Mode: there is an on-prem cache. The entire data set is stored in S3. Low latency.

  • Stored Volume Mode: the entire data set is on-prem. Backed-up to S3 using EBS point-in-time snapshots. Async. Snapshots are compressed and incremental.

  • Up to 32 volumes per Volume Gateway.

  • In cached mode, each volume can be up to 32 TB. Maximum of 1 PB data per gateway.

  • In stored mode, each volume can be up to 16 TB. Maximum of 512 TB data per gateway.

Tape Gateway

  • A back-up server connects over ISCI to a Virtual Tape Library (Tape Gateway).
  • Standard tape backup applications can be used on the back-up server.
  • Data is initially stored as S3 Standard.
  • Once ejected, data can be stored using Glacier or Deep Archive.
  • Data at rest is encrypted server-side with SSE-S3.