Jump to content













Photo
- - - - -

Azureheads #15 | Integrate your data to the cloud meetup resources

  Posted by Pantelis Apostolidis , in Azure 24 November 2018 · 20 views

<div class="soliloquy-feed-output"><img class="soliloquy-feed-image" src="https://www.e-aposto...-960x600_c.jpg"title="46789713_889845814738675_6306633233308057600_o" alt="46789713_889845814738675_6306633233308057600_o" /></div>
<p>At the 15# Azurehads meetup we talked about how to integrate our data using Azure Data Factory and from the Azure Data Factory to call an Azure HDInsights cluster that will be created on-demand. After the process ends, the HDInsights cluster will be automatically deleted.</p>
<p>Also we saw how we can copy and transform data from almost any source to almost any location.</p>
<p>Download the presentation: <a href="http://bit.ly/AH15Pr...ntation</a></p>
<p>Download the demo video: <a href="http://bit.ly/AH15Vi...15Video</a></p>
<p>Download the project files: <a href="http://bit.ly/AH15Pr...ctfiles</a></p>
<p>At the demo, we created a data factory. At the data factory we created a pipeline that reads a Python script from an Azure Storage account folder. THe Azure Data FActory creates an on-demand HDInsights Spark cluster and runs the python script. The python script reads a text and provides for output a text with the word count of the input text. Finally the cluster is automatically deleted.</p>
<p><img class="alignnone wp-image-2282 size-large" src="https://www.e-aposto...e-1024x541.jpg"alt="" width="840" height="444" srcset="https://www.e-apostolidis.gr/wp-content/uploads/2018/11/intropage-1024x541.jpg 1024w, https://www.e-aposto...age-300x159.jpg 300w, https://www.e-aposto...age-768x406.jpg 768w, https://www.e-aposto...age-600x317.jpg 600w, https://www.e-aposto...1/intropage.jpg 1336w" sizes="(max-width: 840px) 100vw, 840px" /></p>
<p><a class="a2a_button_email" href="https://www.addtoany...etup resources"title="Email" rel="nofollow noopener" target="_blank"></a><a class="a2a_button_print" href="https://www.addtoany.com/add_to/print?linkurl=https%3A%2F%2Fwww.e-apostolidis.gr%2Fmicrosoft%2Fazure%2Fazureheads-15-integrate-your-data-to-the-cloud-meetup-resources%2F&amp;linkname=Azureheads%20%2315%20%7C%20Integrate%20your%20data%20to%20the%20cloud%20meetup%20resources" title="Print" rel="nofollow noopener" target="_blank"></a><a class="a2a_dd addtoany_share_save addtoany_share" href="https://www.addtoany.com/share#url=https%3A%2F%2Fwww.e-apostolidis.gr%2Fmicrosoft%2Fazure%2Fazureheads-15-integrate-your-data-to-the-cloud-meetup-resources%2F&title=Azureheads%20%2315%20%7C%20Integrate%20your%20data%20to%20the%20cloud%20meetup%20resources" data-a2a-url="https://www.e-apostolidis.gr/microsoft/azure/azureheads-15-integrate-your-data-to-the-cloud-meetup-resources/" data-a2a-title="Azureheads #15 | Integrate your data to the cloud meetup resources"><img src="https://static.addtoany.com/buttons/share_save_171_16.png" alt="Share"></a></p><p>The post <a rel="nofollow" href="https://www.e-apostolidis.gr/microsoft/azure/azureheads-15-integrate-your-data-to-the-cloud-meetup-resources/">Azureheads #15 | Integrate your data to the cloud meetup resources</a> appeared first on <a rel="nofollow" href="https://www.e-apostolidis.gr">Apostolidis IT Corner</a>.</p>


<a href="https://www.e-aposto...tup-resources/"class='bbc_url' rel='nofollow external'>Source</a>