Storage as a Service

Intel® Developer Cloud storage as a service (STaaS) simplifies model training and inference. Your project may require storing large amounts of unstructured data to improve model accuracy. Our storage solutions address:

  • Scalability

  • Accessibility

  • Latency

  • Throughput

Tip

The current offering only includes file-system storage.

Prerequisites

Complete these guides before using this one.

Create volume

  1. In the console, at left, select Storage. The Storage Console appears.

  2. Click Create volume.

  3. Enter data in the following fields:

    • Name

    • Description

    • Storage size

    Create volume

    Storage - Create volume

    Note

    Follow onscreen instructions to meet requirements.

  4. After data entry is accepted, click Launch.

Delete volume

  1. In the console, at left, select Storage.

  2. In the Actions column, select Delete.

    Delete

    Storage - Delete volume

  3. A dialog box requests confirmation.

  4. Select Delete to proceed, or select Cancel to abort.

Mount volume

  1. Select Storage in the left-side menu.

  2. Click the name of your storage volume to show details.

  3. Select How to mount.

    Choose between single instance and instance group.

    Storage - Mount volume

    Note

    You must have an instance available from which you can connect to the storage volume.

  4. Click the Instance drop-downn menu.

    Your instance should appear. Return to Manage Instance if you need to create a new instance.

    Select an instance

    Select an instance

  5. Choose Mount your volume.

  6. Make sure to launch an instance from which you will mount a volume.

  7. Follow the onscreen instructions to mount your volume.

    How to mount storage volume

    How to mount storage volume

    Note

    Commands shown are subject to change, based on the instance type.

  8. After entering “login to the weka cluster”, you're instructed to’ “Enter your password at prompt”.

  9. In the Security tab, click Generate password.

    How to mount storage volume

    How to mount storage volume

  10. In the pop-out dialog, click the copy button beside Password.

  11. Paste that password into your Terminal instance.

    Note

    On most systems, use right-click, or CTRL+V, to paste the password. Once pasted, the password will not appear.

  12. Press <Enter> to login.

  13. Allow any downloads to complete as applicable.

  14. Your Terminal output should show Mount completed successfully, as below.

    Mount completed successfully

    Mount completed successfully

Verify Storage

Assure that you’re logged into your instance. Next, you can view mount points and perform basic file I/O operation.

View filesystem mount points:

df -h

To view more details, like Type and Size, try:

df -aTh

Change directory into the storage volume.

cd /mnt/test

Suppose you want to download a sample dataset from the UC Irvine Machine Learning Repository In this example, we download Online Retail dataset as a CSV file.

sudo curl -o data_online_retail.csv https://archive.ics.uci.edu/dataset/352/online+retail

FAQ

Question

Answer

Can I share file-system data across multiple instances?

Yes. You can mount the same storage on multiple instances to share the data.

Do you recommend bare metal or virtual machine storage for specific use cases?

Mounting on bare metal will be slightly faster. Note: Mounting on a Guadi2 instance requires different mount commands.

Is there a limit (e.g., quota) to the number or the size of storage volumes?

Yes. The number of instances available varies across account type and processor type. Generally, the number of instances available increases from Standard to Enterprise accounts.

If you exceed the quota, please contact Support. Enterprise users, please contact your representative.