Pushing Hadoop Cluster Configuration Changes using PowerShell
In my previous post I talked about Implementing and Deploying Rack Awareness using PowerShell. However PowerShell is a great tool for not only managing things like Rack Awareness but for installing and...
View ArticleDeploying Hadoop Rack Awareness with PowerShell
In a previous post I talked about Implementing Hadoop Rack Awareness with PowerShell. One thing I skimmed over in this post was how to deploy the necessary files to the cluster and make the...
View ArticleImplementing Hadoop Rack Awareness with PowerShell
This post walks-through building a PowerShell script for enabling Rack Awareness in Hadoop. While several example scripts can be found online for Linux, samples building a script for Windows is less...
View ArticleManaging Your HDInsight Cluster using PowerShell – Update
Since writing my last post Managing Your HDInsight Cluster and .Net Job Submissions using PowerShell, there have been some useful modifications to the Azure PowerShell Tools. The HDInsight cmdlets no...
View ArticleClik here to view.
Managing Your HDInsight Cluster and .Net Job Submissions using PowerShell
This post explains how best to manage an HDInsight cluster using a management console and Windows PowerShell. The goal is to outline how to create a simple cluster, provide a mechanism for managing an...
View ArticleImplementing LOB Storage in Memory Optimized Tables
Memory optimized tables do not have off-row or large object (LOB) storage, and the row size is limited to 8060 bytes. Thus, storing large binary or character string values can be done in one of two...
View ArticleClik here to view.
Managing Hive Job Submissions With PowerShell
In my previous post, I talked about “Managing Your HDInsight Cluster with PowerShell”. In this post I made no mention of using Hive. I hope to re-address this balance by specifically talking about how...
View ArticleClik here to view.
Managing Your HDInsight Cluster with PowerShell
An updated version of this post can be found here. This blog post provides a mechanism for managing an HDInsight cluster using a local management console through the use of Windows PowerShell. The goal...
View ArticleClik here to view.
Hadoop .Net HDFS File Access
Provided with the Microsoft Distribution of Hadoop, HDInsight, is a C library for HDFS file access. This code extends this library through a Managed C++ solution. This solution enables one to consume...
View ArticleSubmitting Hadoop MapReduce Jobs using PowerShell
As always here is a link to the “Generics based Framework for .Net Hadoop MapReduce Job Submission” code. In all the samples I have shown so far I have always used the command-line consoles. However...
View ArticleClik here to view.
Implementing a MapReduce Join with Hadoop and the .Net Framework
I have often been asked how does one implement a Join whilst writing MapReduce code. As such, I thought it would be useful to add an additional sample demonstrating how this is achieved. There are...
View ArticleClik here to view.
Framework for .Net Hadoop MapReduce Job Submission V1.0 Release
It has been a few months since I have made a change to the “Generics based Framework for .Net Hadoop MapReduce Job Submission” code. However I was going to put together a sample for a Reduce side join...
View ArticleClik here to view.
Framework for .Net Hadoop MapReduce Job Submission TextOutput Type
Some recent changes made to the “Generics based Framework for .Net Hadoop MapReduce Job Submission” code were to support Json and Binary Serialization from Mapper, in and out of Combiners, and out from...
View ArticleClik here to view.
C# MapReduce Based Co-occurrence Item Based Recommender
As promised, to conclude the Co-occurrence Approach to an Item Based Recommender posts I wanted to port the MapReduce code to C#; just for kicks and to prove the code is also easy to write in C#. For...
View ArticleClik here to view.
MapReduce Based Co-occurrence Approach to an Item Based Recommender
In a previous post I covered the basics for a Co-occurrence Approach to an Item Based Recommender. As promised, here is the continuation of this work, an implementation of the same algorithm using...
View ArticleClik here to view.
Framework for .Net Hadoop MapReduce Job Submission Json Serialization
A while back one of the changes made to the “Generics based Framework for .Net Hadoop MapReduce Job Submission” code was to support Binary Serialization from Mapper, in and out of Combiners, and out...
View ArticleClik here to view.
Framework for .Net Hadoop MapReduce Job Submission configuration update
To better support configuring the Stream environment whilst running .Net Streaming jobs I have made a change to the “Generics based Framework for .Net Hadoop MapReduce Job Submission” code.I have fixed...
View ArticleClik here to view.
Framework for .Net Hadoop MapReduce Job Submission Binary Output
To end the week I decided to make a minor change to the “Generics based Framework for .Net Hadoop MapReduce Job Submission”.I have been doing some work on creating a co-occurrence matrix for item...
View ArticleClik here to view.
Framework for .Net Hadoop MapReduce Job Submission libjars update
If you have been using the “Generics based Framework for .Net Hadoop MapReduce Job Submission” you may want to download the latest version of the code.The previous version of the code, when processing...
View ArticleClik here to view.
Generics based Framework for .Net Hadoop MapReduce Job Submission
Over the past month I have been working on a framework to allow composition and submission of MapReduce jobs using .Net. I have put together two previous blog posts on this, so rather than put together...
View Article
![[TVRIP] Vertex Force [バーテックスフォース] 第01話](http://animerss.com/img/TVRIP-Vertex-Force.jpg)
