Shai Raiten's Blog : Share Point

SharePoint API – Download \ Upload Documents (Tool)

shair — Thu, 27 Oct 2011 13:03:00 GMT

A long time ago I wrote about SharePoint 2007 Files Restore Tool, tool that allows you to connect to SharePoint content database (not need to have SharePoint installation) and extract documents.

The reason I wrote this tool was a customer that upgrade TFS and perform a new installation of SharePoint so he lost all his documents, this tool helped me to extract all documents and added them to the new SharePoint site.

SharePoint upgrade/migration can be unpleasant and sometimes I prefer to do a clean installation when upgrading or moving TFS and then just import the documents (without history).
Some customers wants to keep the history, so you can do small changes to download all file versions and then upload each version.

The big questions is how to extract all SharePoint documents from existing Site?

So, I’ve built another tool to help me do that, the below tool will connect to SharePoint using API and download all documents includes Folder structure to my computer.

Because I’m using SharePoint API you can write any Url of the SharePoint site, I’ll show the all documents folders includes files under each folder, and then you can click the download button to download all files or specific files to your machine.

How To Connect SharePoint Site:

* SharePoint API will only work on Machine with SharePoint installed *

public SPWeb _sp;
public void Connect()
{
    try
    {

        using (SPSite site = new SPSite(txtSPUrl.Text))
        {

            TreeFolders.Items.Clear();
            var webTree = new TreeViewItem();
            webTree.Header = _sp.Title;
            webTree.Tag = _sp;
 
            MapFolders(_sp.Folders, webTree);
        }
    }
    catch (Exception ex)
    {
        throw new ArgumentException("Connect", ex);
    }
}

Building Folder Structure

I’ve created a recursive method to get the total number of files under a specific folder include all sub folders.

private int GetFilesCount(SPFolder folder, int count)
{
    count += folder.Files.Count;
    return folder.SubFolders.Aggregate(count, (current, subfolder) => 
           GetFilesCount(subfolder, current));
}
 
private void MapFolders(SPFolderCollection folderList,
                                             TreeViewItem treeNode)
{
    for (var i = 0; i < folderList.Count; i++)
    {
        var item = new TreeViewItem();
        item.Header = string.Format("{0} ({1})", folderList[i].Name,
                                     GetFilesCount(folderList[i], 0));
        item.Tag = folderList[i];
 
        treeNode.Items.Add(item);
 
        if (folderList[i].SubFolders.Count > 0)
            MapFolders(folderList[i].SubFolders, item);
    }
}

Download Files From SharePoint Folder

The CreateDirectoryStructure will build the local folder structure based on the file path in SharePoint, this is important because once we want to upload those files to a new SharePoint site we need those folder names in order to create them in the new SharePoint site.

Each SPFolder object contains a SPFileCollection with all files under that folder – Not include SubFolder files.

DownloadFile – will run over all files, get each file binary data and save the stream to a local file.

private void DownloadFile(SPFileCollection files)
{
    foreach (SPFile file in files)
    {
        if (CreateDirectoryStructure(txtLocalPath.Text, file.Url))
        {
           var filepath = System.IO.Path.Combine(txtLocalPath.Text,
                                                 file.Url);
           byte[] binFile = file.OpenBinary();
           System.IO.FileStream fstream = System.IO.File.Create(filepath);
           fstream.Write(binFile, 0, binFile.Length);
           fstream.Close();
        }
        else
           throw new ArgumentException("Cannot Create Folders Structure");
    }
}
 
private bool CreateDirectoryStructure(string baseFolder, string filepath)
{
    if (!Directory.Exists(baseFolder)) return false;
 
    var paths = filepath.Split('/');
 
    for (var i = 0; i < paths.Length - 1; i++)
    {
        baseFolder = System.IO.Path.Combine(baseFolder, paths[i]);
        Directory.CreateDirectory(baseFolder);
    }
    return true;
}

Upload File To SharePoint Site

Once you got all files from the Old SharePoint site you can enter the new SharePoint site url and click the Upload button.

private void btnUpload_Click(object sender, RoutedEventArgs e)
{
    using (SPSite site = new SPSite(txtTargetSP.Text))
    {
        SPWeb targetSP = site.OpenWeb();
        foreach (var file in listLocalFolders.Items.Cast<string>().Select
                (folder => Directory.GetFiles(folder, "*.*", 
                 SearchOption.AllDirectories)).SelectMany(files => files))
        {
            UploadFile(file, file.Replace(txtLocalPath.Text, string.Empty)
                       , targetSP);
        }
    }
}

Removing the local path from the full file path will result with the destination file to the new SharePoint site.

The propose of EnsureParentFolder is to ensure the destination folder in the new SharePoint site exists, and if not create the folder in the new site.

UploadFile will stream out the file content and using SPWeb.Files.Add method include the destination path will add a new file to the SharePoint site.

public string EnsureParentFolder(SPWeb parentSite, string destinUrl)
{
    destinUrl = parentSite.GetFile(destinUrl).Url;
 
    var index = destinUrl.LastIndexOf("/");
    var parentFolderUrl = string.Empty;
 
    if (index > -1)
    {
        parentFolderUrl = destinUrl.Substring(0, index);
        SPFolder parentFolder
            = parentSite.GetFolder(parentFolderUrl);
 
        if (!parentFolder.Exists)
        {
            SPFolder currentFolder = parentFolderUrl.Split('/').
            Aggregate<string, SPFolder>(parentSite.RootFolder, 
           (current, folder) => current.SubFolders.Add(folder));
        }
    }
    return parentFolderUrl;
}
 
public void UploadFile(string srcUrl, string destUrl, SPWeb site)
{
    if (!File.Exists(srcUrl))
    {
        throw new ArgumentException(String.Format("{0} does not exist",
            srcUrl), "srcUrl");
    }
 
    var fStream = File.OpenRead(srcUrl);
    var contents = new byte[fStream.Length];
    fStream.Read(contents, 0, (int)fStream.Length);
    fStream.Close();
 
    if (destUrl.StartsWith("\\"))
        destUrl = destUrl.Substring(1);
 
    destUrl = destUrl.Replace("\\", "/");
 
 
    EnsureParentFolder(site, destUrl);
 
    try
    {
        site.Files.Add(destUrl, contents, true);
    }
    catch (Exception ex)
    {
    }
}

Enjoy

SharePoint 2007 Files Restore Tool

shair — Fri, 25 Feb 2011 17:18:14 GMT

SharePoint 2007 Files Restore Tool

I had a customer that need to restore some files from a deleted SharePoint site (long story….) in TFS 2010, the first option is to restore the entire TFS 2010 database include the SharePoint content database but instead of doing all this work I’ve written a small tool to help with that issue.

Just restore the WSS_Content database (the version before the deletion) to another sql instance and use the tool to hook the database and restore the files you needed.

This tool can also help you export files from existing SharePoint 2007 Content Database.

Download Tool

Enjoy

WSS 2.0 Upgrade To WSS 3.0 Failed With Violation of UNIQUE KEY constraint 'AllUserData_Url'

shair — Thu, 16 Sep 2010 17:26:08 GMT

WSS 2.0 Upgrade To WSS 3.0 Failed With Violation of UNIQUE KEY constraint 'AllUserData_Url'

Couple of days a ago I had a very strange problem performing full upgrade from TFS 2005 to TFS 2010, the TFS upgrade went just fine but the WSS upgrade from 2 to 3 throws many couple of wired errors.

The WSS 2.0 to WSS 3.0 upgrade suppose to be “easy”, but this time I was though I got to a dead-end:

WSS 2.0 Prescan –> Scan finished without failure.
Installed WSS 3.0 and choose to perform Upgrade.
Configuration \ Upgrade Failed.

After a deep dive in couple of upgrade logs I found the following error:

[SPContentDatabaseSequence] [ERROR] [9/13/2010 1:43:45 PM]: Action 3.0.87.0 of Microsoft.SharePoint.Upgrade.SPContentDatabaseSequence failed.
[SPContentDatabaseSequence] [ERROR] [9/13/2010 1:43:45 PM]: Violation of UNIQUE KEY constraint 'AllUserData_Url'. Cannot insert duplicate key in object 'dbo.AllUserData'.
The statement has been terminated.

Violation of UNIQUE KEY constraint 'AllUserData_Url'. Cannot insert duplicate key in object 'dbo.AllUserData'.

This issue occurs when the WSS 2.0 site content includes discussion boards that have similar names.
For example, this issue occurs when the names of the discussion boards are Discussion Board1, Discussion Board2, and Discussion Board3.
In this case, the upgrade process cannot determine the unique name of each discussion board because the names of the discussion boards are similar.

Solution – See KB - http://support.microsoft.com/kb/937290

To resolve this issue, use Microsoft Office SharePoint Designer 2007 or Microsoft Office FrontPage 2003 to rename the discussion boards before you try to upgrade from Windows SharePoint Services 2.0.

*** The discussion board names may looks completely different from WSS, but the real name will only revel him self using SharePoint Designer and front page. ***

Hope this helps.

TFS 2010 - TF30177 – Team Project Creation Failed

shair — Mon, 19 Jul 2010 12:57:59 GMT

TFS 2010 - TF30177 – Team Project Creation Failed

Today I tired to create new Team Project on TFS 2010 (Upgraded from 2008) and I got the following error:

The Project Creation Wizard encountered a problem while uploading documents to the following server running Sharepoint Products: server..,. The reason for the failure cannot be determined at this time. Because the operation failed, the wizard was not able to finish creating the team project.

I’ve checked for permissions and everything is Fine, I went to the TFS Administration Console to check if the SharePoint connection and saw there is a problem with the TswaWebPartCollection.wsp feature. (This works couple of days ago, so I don’t really know the real reason why that happed)

To deploy TswaWebPartCollection.wsp feature, open Sharepoint system administration go to “Operations” tab and click on “Solution Manager”.

Click on the “TswaWebPartCollection.wsp” and deploy the feature, ,now everything should work just fine.

Where Is “Create or extend Web Application” Link?

shair — Sun, 25 Apr 2010 21:02:00 GMT

Where Is “Create or extend Web Application” Link?

I just post about Install MOSS On Windows 7 and stuck with another problem, Where Is “Create or extend Web Application” Link?

To add a new collection to MOSS I need to have a Web Application but I can’t create one because the link is missing.

All you need to do is launch IE with "run as administrator" to see the "Create or extend Web Application".

Enjoy

Install MOSS On Windows 7

shair — Sun, 25 Apr 2010 20:54:44 GMT

Install MOSS On Windows 7

In couple of days I’m going to lecture about MOSS\WSS Load Testing using Visual Studio 2010, for that reason I need to install MOSS on my computer – Lot’s Of Cool Demos!

So after a very fast search I found this great article on how to do it - For more information here is the full article

So how to get started?

First you need to download the SharePoint installation -

Windows SharePoint Services 3.0 with Service Pack 1 or Windows SharePoint Services 3.0 x64 with Service Pack 1

But you’ll notice that this message popup, this because MOSS \ WSS can only be installed on Windows Server 2003/2008.

Every Things Is Alright Thanks to Bamboo

Using Bamboo Setup Helper file you can install MOSS \ WSS on Windows Vista \ 7!

Run the setup (next next next).

When the installation has finished placed the SharePoint installation you downloaded before and placed it in the same folder as “SetupLauncher”.

When you run “SetupLauncher” a console window will appears,select SharePoint setup file and run it.

And Walla!

For more information here is the full article

Enjoy

How To: Users cannot access to Team System SharePoint

shair — Thu, 30 Apr 2009 16:39:15 GMT

How To: Users cannot access to Team System SharePoint

Team System works with different levels of security for each module, for example SharePoint, Source Control, Reports etc…

One of the most common issue is SharePoint security, I’m getting emails regarding this problem every week,
Here is the solution:

To perform this operation you need administrator user.

Open SharePoint portal by right click on your Team Project and “Show Project Portal” .

You should see your project SharePoint portal .

Click on “Site Actions” and pick “Site Settings”

You are now in the Settings page, under Users and Permissions pick “People and groups”

Pick “New” and click “Add Users”.

First write down the name\s of the users or groups and click check to make sure the user or group are valid,

than select the right permissions for the user/group and click “OK”.

Enjoy.

How do you move (or copy) documents from one library to another while keeping version history intact?

Shai Raiten — Sun, 30 Nov 2008 11:03:52 GMT

How do you move (or copy) documents from one library to another while keeping version history intact?

Lots of people have this problem when moving\copying files in SharePoint from folder to folder you lose your document version history.

This need is so obvious, but still not included in WSS,

So Here is a great post by Dink in SharePoint Blogs.

Using Team Foundation Server to Develop Custom SharePoint Products and Technologies Applications

Shai Raiten — Mon, 20 Oct 2008 20:42:40 GMT

Using Team Foundation Server to Develop Custom SharePoint Products and Technologies Applications

Here is a nice article about how to use Microsoft Visual Studio 2008 Team Foundation Server to support SharePoint application development, and provide an integrated development environment and single source code repository for process activities, integrated progress reporting, and team roles.

http://msdn.microsoft.com/en-us/library/cc948982.aspx