Developing with Windows Azure storage & SQL Azure

Windows Azure StorageSQL Azure Developing with Windows Azure storage & SQL Azure Maarten Balliauw http://blog.maartenballiauw.be http://twitter.com/maartenballiauw maarten@maartenballiauw.be

Whoam I? Maarten Balliauw Antwerp, Belgium www.realdolmen.com Focus on web ASP.NET, ASP.NET MVC, PHP, Azure, VSTS, … Special interest in interop PHPExcel, PHPLinq, PHPMEF, Windows Azure SDK for PHP, ... http://blog.maartenballiauw.be http://twitter.com/maartenballiauw

Windows Azure Data Storage Queue Blob Account Tables Drives

Azure Platform Data Storage Options Windows Azure Data Storage Blobs Unstructured data storage Tables Semi-structured or tabular data storage Queues Buffered delivery data storage Drives Durable NTFS volumes that Windows Azure applications can use. See: http://microsoftpdc.com/Sessions/SVC14 SQL Azure Relational data storage

PHP + Cloud Storage Windows Azure Storage PHP Instance (web/worker) On-Premise VIP Load Balancer PHP App SQL Azure Windows Azure Platform

Windows Azure SDK for PHP A PHP porgramming model for Windows Azure Storage

PHP with Windows Azure Storage Windows Azure SDK for PHP at http://phpazure.codeplex.com PHP programming model for Windows Azure Storage Features PHP classes for Blobs, Tables & Queues Store PHP sessions in Table Storage File system wrapper for Blob Storage

Blob Container Entities Account Table http://<account>.blob.core.windows.net/<container> Messages Windows Azure Storage Concepts http://<account>.table.core.windows.net/<table> Queue http://<account>.queue.core.windows.net/<queue>

Windows Azure Blobs Unstructured data Scale massively At least 3 instances, 5 in optimal situation Can be used as CDN Can be mapped using a custom domain

Tools for connecting to blob storage CloudBerryLab Explorerhttp://www.cloudberrylab.com Azure Storage Explorerhttp://azurestorageexplorer.codeplex.com/ Onlinehttp://myazurestorage.com / ftp://ftp.cloudapp.net Windows Azure tooling for Eclipse

Blobs Sample $blobStorage= new Microsoft_WindowsAzure_Storage_Blob(); // Create if (!$blobStorage->containerExists($containerName)) { $blobStorage->createContainer($containerName); $blobStorage->setContainerAcl($containerName, Microsoft_WindowsAzure_Storage_Blob::ACL_PUBLIC); } // Store $blob = $blobStorage->putBlob($containerName, $blobName, $localFilename, $metadata); /* @var $blob Microsoft_WindowsAzure_Storage_BlobInstance */

Blobs Sample Cont… // Copy $result = $blobStorage->copyBlob( $containerName, $blobName, $containerName, $blob2Name); // Retrieve $tempStore= azure_getlocalresourcepath('tempstore'); $tempPath= $tempStore. '' . $imageId; $blobStorage->getBlob($containerName, $blobName, $tempPath); // Delete $result = $blobStorage->deleteBlob($containerName, $blobName); $result = $blobStorage->deleteContainer($containerName); http://phpazurecontrib.codeplex.com

Blob Stream Wrapper $blobStorage= new Microsoft_WindowsAzure_Storage_Blob(); // Register: $blobStorage->registerStreamWrapper(); // registers azure:// // or $blobStorage->registerStreamWrapper('blob://'); // use blob:// // Use $fp= fopen('azure://mycontainer/myfile.txt', 'r'); // ... fclose($fp);

Windows Azure Drive (a.k.a. Xdrive) Virtual NTFS volume that can be mounted .vhd format Use existing NTFS API’s Easier migration Stored on blob storage provides quick mount/unmount in other VM

Queue Workflow Concepts Windows Azure Queue Provides Guarantee delivery (two-step consumption) Worker Dequeues Message and mark it as Invisible Worker Deletes Message when finished processing it If Worker role crashes, message becomes visible for another Worker to process Doesn’t guarantee “only once” delivery Doesn’t guarantee ordering Best effort FIFO Worker Role Web Role Input Queue (Work Items) Worker Role Azure Queue Web Role Worker Role Web Role Worker Role

Azure Queues RemoveMessage GetMessage (Timeout) Worker Role PutMessage Queue Msg 1 Msg 2 Msg 2 Msg 1 Web Role Worker Role Worker Role Msg 3 Msg 4 Msg 2

Loosely Coupled Work with Queues Worker-Queue Model Load work in a queue Many workers consume the queue Input Queue (Work Items) Azure Queue Worker Role Web Role Worker Role Web Role Worker Role Web Role Worker Role

Queues $queueClient= new Microsoft_WindowsAzure_Storage_Queue(); // Create $result = $queueClient->createQueue('imageQueue'); // Delete $queueClient->deleteQueue('imageQueue'); // Add message $queueClient->putMessage('imageQueue', $message, $ttl); // Retrieve Messages $messages = $queueClient->getMessages('imageQueue', 10); foreach($messages as $message) { // Do work here... $queueClient->deleteMessage('imageQueue', $message); }

Windows Azure Data Storage – Tables (Terms Part 1) Table Contains a set of entities. Entity (Row) Basic data items stored in a table. Property (Column) Single value in an entity. RowKey Unique ID of the entity within a partition Timestamp Time it was created

Windows Azure Data Storage – Tables (Terms Part 2) Partition Entities in a table with the same partition key PartitionKey Segments entities in to partitions to automatically distribute the table’s entities over many storage nodes. Sort Order There is a single index provided, where all entities in a table are sorted by PartitionKey and then RowKey

Key Example – Blog Posts Partition 1 Partition 2 Getting all of dunnry’s blog posts is fast Single partition Getting all posts after 2008-03-27 is slow Traverse all partitions

Table Sample $tableStorage= new Microsoft_WindowsAzure_Storage_Table( 'table.core.windows.net', 'myaccount', 'myauthkey'); // Create $result = $tableStorage->createTable($tableName); // List $result = $tableStorage->listTables(); foreach($result as $table) { echo 'Table name is: ' . $table->Name . ""; } // Delete $tableStorage->deleteTable($tableName);

Tables with Entities // Structured entity class ImageEntityextends Microsoft_WindowsAzure_Storage_TableEntity { /** * @azure filename */ public $filename; /** * @azure size Edm.Int64 */ public $size; } // Unstructured entity // Microsoft_WindowsAzure_Storage_DynamicTableEntity

Tables with Entities Cont… // Insert $image = new ImageEntity($partitionKey, $rowKey); $image->filename = $_FILES['imageUpload']['name']; $image->size = $_FILES['imageUpload']['size']; $image = $tableStorageClient->insertEntity($tableName, $image); // Retrieve $image = $tableStorage->retrieveEntityById($tableName, $partitionKey, $rowKey, 'ImageEntity'); // Update $image->filename = 'newname.jpg'; $result = $tableStorage->updateEntity($tableName, $image); // Delete $result = $tableStorage->deleteEntity($tableName, $image);

Table Queries // Filter condition $select = "filesizegt 1024 and PartitionKeyeq '$partitionKey'"; // Or fluent interface $select = $tableStorage->select()->from($tableName) ->where('filesizegt 1024') ->andWhere('PartitionKeyeq ?', $partitionKey); // Run query $images = $tableStorage->storageClient->retrieveEntities( 'testtable', $select, 'ImageEntity' ); foreach($images as $image) { echo 'Name: ' . $image->filename . ""; }

Batching Operations // Start batch $batch = $tableStorage->startBatch(); // Insert multiple $images = generateEntities(); foreach($images as $image) { $tableStorage->insertEntity($tableName, $image); } // Commit $batch->commit();

Table session handler $sessionHandler = new Microsoft_WindowsAzure_SessionHandler($tableStorage); $sessionHandler->register(); session_start(); if (!isset($_SESSION['start'])) { $_SESSION['start'] = time(); }

SQL Azure A relational database for the cloud

SQL Azure and Windows Azure Table Comparison SQL Azure Tables Windows Azure Tables Fully structured Strongly typed Relational(RDBMS) Highly scalable Semi-structured Loosely typed Non-Relational(Not RDBMS) Massively scalable

MySQL: Simple Configuration VIP Load Balancer Web Role MySQL Worker Role

MySQL in a Windows Azure Application Running MySQL in a worker role Copy MySQL to the worker role sub-directory Copy to read-write local storage Configure MySQL to listen on the right port Monitor MySQL health Consuming MySQL Discover IP address and port Normal access from then on Handle topology changes

Simple Configuration VIP Load Balancer MySQL

Replication VIP Load Balancer M S S MySQL MySQL MySQL

Windows Azure Drive with Hot Spare VIP Load Balancer MySQL MySQL

SQL Azure Features Supported Not supported Tables, Indexes, Views Stored Procedures Triggers Constraints Table Variables Temp Tables (#Name) Physical Server Access Catalog DDL Common Language Runtime Service Broker Reporting Services Analysis Services Distributed Transactions and Queries

SQL AzureDeployment Web Portal (API) DB Script SQL Azure TDS

SQL AzureAccessing databases Web Portal (API) Your App SQL Azure TDS Change Connection String

Database Replicas Single Database Multiple Replicas Replica 1 Single Primary Replica 2 DB Replica 3

SQL AzureDatabase Monitoring & Recovery Web Portal (API) ! Your App SQL Azure TDS

Developing with Windows Azure storage & SQL Azure

Recommandé

Recommandé

Contenu connexe

Tendances

Tendances (20)

En vedette

En vedette (7)

Similaire à Developing with Windows Azure storage & SQL Azure

Similaire à Developing with Windows Azure storage & SQL Azure (20)

Plus de Maarten Balliauw

Plus de Maarten Balliauw (20)

Dernier

Dernier (20)

Developing with Windows Azure storage & SQL Azure

Notes de l'éditeur