ItayBraun : Tech Ed

Many Videos from Tech-ED 2011 (North America). One of them about Enterprise Data Mining

ItayBraun — Thu, 09 Jun 2011 20:10:00 GMT

אחד התחומים היותר מורכבים בתחום ה BI הוא הנושא של כריית נתונים, data mining. הרעיון מאחורי כריית נתונים הוא מציאת דפוסים נסתרים ומתוחכמים בנתונים.

בויקיפדיה המונח כריית נתונים מוגדר כך:

כריית מידע או כריית נתונים (באנגלית: Data mining) היא הפעלת אלגוריתם או תוכנית מחשב לצורך גילוי מידע הטמון בבסיסי נתונים קיימים, והסקת מסקנות מהצלבתו. גילוי ידע בבסיסי נתונים הוא תהליך הנועד לחקור ולנתח כמות גדולה של מידע באמצעים אוטומטיים ככל שניתן כדי לגלות דפוסים תקפים חדשים, שימושיים (מקבלי ההחלטות יכולים להשתמש בדפוסים שהתגלו כדי לשפר תהליכים קיימים) ובעלי משמעות (מובנים למקבל ההחלטות). עם ההתפתחות המתמדת בעולם טכנולוגיית המידע, כשכמות המידע הדיגיטלי גדלה כל הזמן, עולה החשיבות של תחום כריית המידע, שבאמצעותו ניתן להפוך מידע לידע.

ל Analysis Services 2008 יש יכולות data mining מרשימות. סרטון חדש מ Tech Ed 2011 (ארצות הברית) שהתקיים לפני כשבועיים מדגים יכולות אלו.

המון, המון סרטים ותכנים נמצאים באתר של Tech Ed 2011 ב Channel 9. אפשר כמובן לחפש רק סרטונים הקשורים ל Database and BI.

אני צופה בסרטים נוספים ואכתוב כשיהיה לי על מה.

תהנו

איתי בראון

צפו בסרטים ומצגות של טק אד

ItayBraun — Sun, 12 Dec 2010 04:10:00 GMT

למי שפספס או פשוט לא הגיע

http://www.microsoft.com/israel/TechEd2010/

המצגת שלי

http://www.techedagenda.mscom.co.il/online/?pq=24

BI Key note - A lecture from Tech Ed

ItayBraun — Wed, 01 Dec 2010 17:07:00 GMT

BI Key note

Lecturers: Ori Weinroth and Frank Sidi

What's new in SQL Server 2011 BI Services (Code name "Danali")

Integration Services:

Better developer experience - simply adding and removing columns.
Manageability - easier control (didn't explain what exactly)
Zoomx was bought by Microsoft - Integrated data cleansing tool.

Analysis Services

In-memory mode using the Vertipack engine. Now BI Developers can use MOLAP, ROLAP or Vertipack to implement cubes. This will improve our competitions against Qlikview and similar products. You can think about is as real PowerPivot server (PowerPivot uses vertipack engine). We expect many migrations from MOLAP to Vertipack in the near future. More about the subject in a different post.

Reporting Services

Code name "Crescent" is a new project for Silverlight self-service BI tool. This was one of the major problems comparing SSRS 2008 / 2008 R2 to the competitors.
Teaser movie here: http://blogs.msdn.com/b/bi/archive/2010/11/09/data-visualization-done-right-project-crescent.aspx

Relational Engine

Juneau - SQL Server IDE. Not sure I fully understand it. I'll ask for more info.
Always On - next generation HA / DR. There are two sessions for this subject.
Apollo - In memory query processing. New types of indexes (Column based).
Sequences (Oracle like)
Up to 256 Logical Processors

Some Interesting numbers - the largest DB / Single DB / table / Cube

SQL Application of 88 PT
One DB of 70 TB
One table of 20 TB
One cube of 12 TB

Project "Atlanta"

http://www.microsoftatlanta.com/

Configuration Assessment Could service for Microsoft SQL Server. It will check your configuration and alert you if something is wrong.

Parallel Data Warehouse

A lot was said and written about the solution(http://www.microsoft.com/sqlserver/2008/en/us/parallel-data-warehouse.aspx ). At the demo Frank showed some reports. For ex. processing 1.2 B records in 26 seconds. It is a very impressive solution but as you know, designed for at least 50 TB of data. Else, probably it is overkill. Please don't forget this is a solution for Data Warehouse, NOT for OLTP solutions.

Self Service BI

We saw already many demos of PowerPivot (http://www.powerpivot.com/) . Frank demoed how easy it is to join data from the local DB with data from SQL Azure (for ex. statistics about geographic regions my customers live in). Interesting, but not sure how relevant it is to most of my customers.

The second demo was of http://www.getpivot.com/

SQL Azure - Database in the Cloud. A lecure in Tech Ed 2010

ItayBraun — Mon, 29 Nov 2010 14:10:00 GMT

Lecturer: Noam King

A lot was written about SQL Azure. SQL in the Cloud is something I heard a lot about in the last months. I'll explain why I'm under the impression SQL Azure is a great solution for tiny and simple databases only. Most of our customers are enterprise size and the solution is just not ready yet.

The Good things:

Easy management. Setting a database + backup + High Availability finished in less than a minute. The power of the cloud.
Hybrid approach - feel free to place the databases in the cloud and keep your applications local. Of course you can place your application in the cloud too.
Each database has (automatically) two replicated databases with automatic failover.

More info about the capabilities and limitations of SQL Azure can be found in the document General guideline and limitations (SQL Azure)

What's missing?

Unless your database is very simple, probably you'll have to redesign and rewrite the database.
Database is limited to 50 GB so you'll have to design a scale out database solution (federation). However, you will be able to use CREATE FEDERATION command to (relatively) easily partition / federate the data to multiple SQL Azure databases. (not ready yet).
No jobs (yet)
SQL Authentication only, no Windows authentication (yet)
All table must have clustered indexes
Probably there are more limitations, these are just few from the document http://msdn.microsoft.com/en-us/library/ee336245.aspx

Migration wizard

In Codeplex you can find the SQL Server Azure Migration Wizard. The SQL Azure Migration Wizard helps you migrate your local SQL Server 2005 / 2008 databases into SQL Azure. The wizard walks you through the selection of your SQL objects, creates SQL scripts suitable for SQL Azure, and allows you to migrate your data.

Conclusion:

As I said earlier, SQL in the Cloud in great idea and I'm sure sooner or later we'll see great implementations of it. But in the near future I'm afraid it will be very hard to justify such a migration of big complex solution.

SQL Server Azure Reporting Services CTP

The team blog: http://blogs.msdn.com/b/sqlrsteamblog/archive/2010/10/29/sql-azure-reporting.aspx

Sound promising. Still a CTP ( = errors during the demo). I strongly recommend waiting few months before considering implementing it.

SQL Azure Data Sync

Manual Sync of databases. The User has control to which worldwide data center will be deployed. It is a CTP2 version (= erros during the demo)

Itay@twingo.co.il

www.twingo.co.il

My Video for the Coming Tech Ed 2010

ItayBraun — Thu, 25 Nov 2010 22:27:00 GMT

http://www.youtube.com/watch?v=aamFNeyYRNk

Unleash Analysis Services ....

Unleash the power of SSAS - my presentation at Tech Ed

ItayBraun — Thu, 25 Nov 2010 04:49:00 GMT

I'm so busy lately, I barely wrote anything in my blog about my lecture at Tech Ed Israel next week.

As you can imagine, I work very hard on it (among other things such as delivering MDX training, a very interesting BI project for SCCM and SQL Code Review).

So, to make a long story short, I will speak about all the common mistakes I've handled at the 3-4 customers I've visited in the last 10 years. I will demonstrate many quick no-brainer solutions. I'll teach the DBA how to solve 90% of the problems in 10% of the time.

I know the SSAS is a big black box for many DBA. After only one hour you'll know so much more.

Definitely worth coming.

See you all in sunny Eilat

BI Track at Tech Ed

ItayBraun — Mon, 22 Nov 2010 19:14:00 GMT

"חברים יקרים,

ארבעה דברים שלא ידעתם על טק-אד הקרוב, ושבגללו כדאי לכם לרוץ ולהירשם אם עדיין לא נרשמתם:

•1. תהיה חשיפה גדולה ל- SQL Server Denali, הגרסה החדשה של SQL Server. ישנן הרצאות מלוות בהדגמות חיות של פיצ'רים חדשים. למשל, בפעם הראשונה בארץ ניתן לראות את הממשק החדש מבוסס ה-web לחיבור דוחות. נראה כאן את כל ההרצאות שהיו בנושא זה בטק-אד אירופה לפני כשבועיים.

•2. 25% מהמרצים הם מקבוצת המוצר בחו"ל!

•3. לפחות 50% מההרצאות זה דמו.

•4. במסלול יושק מוצר חדש - appliance למחסני נתונים גדולים בשם SQL Server Parallel Data Warehouse.

נתראה בטק-אד במסלול בינה עסקית,

רונן ואיתי"

Many Tech-Ed PowerPoint slide decks (worldwide)

ItayBraun — Tue, 12 Oct 2010 02:39:00 GMT

Tech Ed Israel (http://www.microsoft.com/israel/teched2010/) is just around the corner and I'm working on my lecture about Analysis Services.

There is also an "Ask the Experts" session at the first evening.

In this website you can find all the PowerPoint slide decks from previous events. The BI slides are here

BTW, the website of the previous event (3 years ago) is still online: http://www.microsoft.com/israel/techedevent/list.aspx#b

Enjoy

Itay Braun

www.twingo.co.il

My lecture at Tech Ed 2010

ItayBraun — Fri, 08 Oct 2010 01:46:00 GMT

In the coming Tech Ed in Eilat I'll speak about Analysis Services Performance and Tuning.

http://www.microsoft.com/israel/TechEd2010/Tracks/BI.aspx

Hope to see many readers of the blog there.

itay@twingo.co.il