↧
Submitting Hadoop MapReduce Jobs using PowerShell
As always here is a link to the “Generics based Framework for .Net Hadoop MapReduce Job Submission” code. In all the samples I have shown so far I have always used the command-line consoles. However...
View ArticleHadoop .Net HDFS File Access
Provided with the Microsoft Distribution of Hadoop, HDInsight, is a C library for HDFS file access. This code extends this library through a Managed C++ solution. This solution enables one to consume...
View ArticleManaging Your HDInsight Cluster with PowerShell
An updated version of this post can be found here. This blog post provides a mechanism for managing an HDInsight cluster using a local management console through the use of Windows PowerShell. The goal...
View ArticleManaging Hive Job Submissions With PowerShell
In my previous post, I talked about “Managing Your HDInsight Cluster with PowerShell”. In this post I made no mention of using Hive. I hope to re-address this balance by specifically talking about how...
View ArticleImplementing LOB Storage in Memory Optimized Tables
Memory optimized tables do not have off-row or large object (LOB) storage, and the row size is limited to 8060 bytes. Thus, storing large binary or character string values can be done in one of two...
View ArticleManaging Your HDInsight Cluster and .Net Job Submissions using PowerShell
This post explains how best to manage an HDInsight cluster using a management console and Windows PowerShell. The goal is to outline how to create a simple cluster, provide a mechanism for managing an...
View ArticleManaging Your HDInsight Cluster using PowerShell – Update
Since writing my last post Managing Your HDInsight Cluster and .Net Job Submissions using PowerShell, there have been some useful modifications to the Azure PowerShell Tools. The HDInsight cmdlets no...
View ArticleImplementing Hadoop Rack Awareness with PowerShell
This post walks-through building a PowerShell script for enabling Rack Awareness in Hadoop. While several example scripts can be found online for Linux, samples building a script for Windows is less...
View ArticleDeploying Hadoop Rack Awareness with PowerShell
In a previous post I talked about Implementing Hadoop Rack Awareness with PowerShell. One thing I skimmed over in this post was how to deploy the necessary files to the cluster and make the...
View ArticlePushing Hadoop Cluster Configuration Changes using PowerShell
In my previous post I talked about Implementing and Deploying Rack Awareness using PowerShell. However PowerShell is a great tool for not only managing things like Rack Awareness but for installing and...
View Article
More Pages to Explore .....