Hadoop on Azure – Creating and Running a simple Java MapReduce

יום שני, יוני 4, 2012

Apache Hadoop has a variety of APIs for developing MapReduce applications: you can use the streaming API to create MapReduce applications with almost any programming language, Hadoop pipes adds native support for C++ applications and Hadoop on Azure provides it’s IsotopeJS library for creating JavaScript MapReduce jobs. You can also use a variety of higher-level abstractions and libraries such as Pig and Hive. With that said and done, it is also useful to know how to develop MapReduce applications using Hadoop’s most natural and primal Java API. This API allows you to develop richer, more powerful MapReduce apps and...
one comment

Slides and Demos from my REST via ASP.NET Web API @ WDCIL

יום שני, אפריל 2, 2012

I had a very good time today talking at the Israeli Web Developers Community meeting held at Microsoft Raanana. I Want to thank everyone for participating for a great discussion about REST, Hypermedia and ASP.NET Web API. I would like to take this chance to share my demo code (available here) and slide deck: Thank you all for a fun evening. Yaniv

Upcoming Gigs: REST, Web API and Hadoop

יום שישי, מרץ 30, 2012

It seems that every time I have a talk about Web API’s something big happens, last time Microsoft moved it from WCF to ASP.NET and this week Microsoft announced about the release of ASP.NET web stack under an open source license. This announcement comes a the beginning of a couple of very exciting months for me covered with talks about few things that ware the focus of my professional life for the past year: REST, Web API On Monday, April 2, I will be talking @...

ASP.NET Web API: Fun with verbs

יום שלישי, פברואר 21, 2012

For those of you who do follow me on twitter (shame on you), last Thursday’s announcement about the reincarnation of the WCF Web API as the ASP.NET Web API could not come in worst timing. As I was scheduled to deliver a 3 hours session in Microsoft for an audience of WCF developers entitled REST via the WCF Web API. Since yours truly is not one of those speakers that is willing to talk about last weeks technology, I have spent most of the weekend rewriting my demos and rebuilding the session (the demos can be found here). ...
one comment

Improve WCF services testability with simple Dependency Injection

יום שני, ינואר 30, 2012

Dependency injection is a great technique to reduce coupling between components and improve testability. There are few techniques we can create dependency injections, you can use a framework like MEF or spring to Automate dependency injection but I personally favor manually injected dependencies. call me old fashion, but I like creating object via simple constructor calls (most of the time). This is really straight forward most of the time but when dealing with WCF services there is a slight complexity to take in to consideration. In most scenarios WCF is in charge of instantiating the service class (the...

MSDN Israel Windows Azure and SQL Azure forum

יום חמישי, ינואר 19, 2012

I am very happy to announce the opening of a new Windows Azure and SQL Azure forum in Hebrew. The new forum is managed by Shay Friedman and myself. If you are new to Windows Azure, I would like to use this opportunity to invite you to experience cloud development with our support and guidance. If you are already experienced with Windows Azure development I would like to assure you that you can find in our forum help from highly experienced professionals. With your participation I am sure we can create an awesome and...

Understanding Widows Azure Queue Storage Throughput

יום שלישי, אוגוסט 23, 2011

The Asynchronous Queuing Pattern describes a classic way to improve service throughput in distributed applications. Over the years I have seen quite a few implementations of this pattern, from the use of MSMQ to ReactiveQueue, each with its own strengths and weaknesses. Windows Azure queue storage is designed for passing messages between applications in a persisted, scalable and controlled manner. With the above attributes, queue storage is a natural choice for enabling the Asynchronous Queuing Pattern, as described in detail in this MSDN magazine article. A recent implementation I ran across at a client challenged the performance...

LINQ to HPC (Formerly known as DryadLINQ) Tutorial: Part 2–Data Partitioning (DSC)

יום שלישי, אוגוסט 9, 2011

A new beta has been released since I wrote part 1 of this tutorial. While very little was changed in the product, we have a new name. Another thing held me back personally from publishing this part was the fact that LINQ to HPC is not a part of Windows HPC R2 SP2. So without farther ado I am proud to present the second part of my tutorial about LINQ to HPC. In part 1 of this tutorial we discussed the fundamentals of DSC: how to manually write data to DSC files and how to use the FromEnumerable<T>...

DryadLINQ Tutorial: Part 1 – Distributed Storage Catalog (DSC) Basics

יום שלישי, יוני 14, 2011

One of the most exciting additions to Windows HPC Server 2008 R2 SP2 (currently in beta) is the support for DryadLINQ. DryadLINQ is an API that allows the creation and execution of large scale, data-parallel compute tasks. One of the core capabilities of Dryad (the underlying framework used by DryaLINQ) is the ability to distribute the data over the cluster and maintain data locality by executing the code on the node storing the data. In order to do both, Dryad utilizes a mechanism called The Distributed Storage Catalog (DSC) which I will cover in this post. ...

What happens in Vegas…

יום חמישי, אפריל 14, 2011

I was woken up tonight by the sounds of Ido and Gil getting ready for their live interview on the Sela College Channel. And let me tell you, it was a slippery slippery slope from there on. I was forced to wait behind the scenes since the main view behind the guys was my bed. The result was quite a funny session with me participating off-screen. If you saw the session, here is how it looked behind the scenes: ...
tags: , , ,
no comments