I’ve been doing several TFS consulting gigs over the last couple of years. The one thing that keeps popping up is the requirement to build several types of platforms using TeamBuild/TFSBuild. My preference is to isolate build agents and their customisations. This means for example that I have a mix of build agents like the following:
- Standard (full VS install + any common additions - WiX for example)
- SharePoint
- BizTalk
Tagging the build agents and configuring the build definitions for those tags then allows the build to be directed to the correct build agent.
The next consideration is that the customisations to the build agent will ideally contain just what is required to build solutions and run unit tests. A SharePoint build agent for example should not have a full SharePoint installed on it. Instead it can just have the required assembly dependencies registered on it to allow the build to succeed.
There is a PowerShell script floating around that assists in harvesting SharePoint assemblies from a development server to then install and configure them on the SharePoint build agent. The original script was published by Microsoft (see here) and subsequently updated by the SharePoint Developer Team to include additional assemblies. The later post also provides a great walkthrough for creating SharePoint build definitions.
We are finding in my current consultation that the client is referencing even more assemblies. Complicating the matter is that several of the assemblies exist in the GAC as both x86 and x64. The PowerShell script does not handle this case and throws an error.
I have updated the PowerShell script to include the following changes:
- Renders all matching files when multiple files match the file name (used to then retarget the included files, see next point)
- Allowed full file paths to be included (including GAC paths in order to specify a particular GAC entry)
- Skipped harvesting files that have already been harvested
- Includes skipping the recursive searching for a filename which was the slowest part of the script
- Added defensive code for updating the registry to point to installed assemblies (previous script threw an error if the registry key already existed)
Here is my version of the SharePoint harvest script.
#==============================================================================
# This script collects and installs the files required to build SharePoint
# projects on a TFS build server. It supports both TFS 2010 and TFS 2008.
#
# Step 1. Run the script on a developer machine where VS 2010 and SP 2010 are installed.
# Use the "-Collect" parameter to collect files required for installation.
#
# Step 2. Copy the script and folder of collected files to a TFS build server.
# Use the "-Install" parameter to install the files.
#
# Copyright (c) 2010 Microsoft Corp.
#==============================================================================
param (
[switch]$Collect,
[switch]$Install,
[switch]$Quiet
)
#==============================================================================
# Script variables
#==============================================================================
# Name of the script file
$MyScriptFileName = Split-Path $MyInvocation.MyCommand.Path -Leaf
# Directory from which script is run
$MyScriptDirectory = Split-Path $MyInvocation.MyCommand.Path
function InitializeScriptVariables()
{
# Program Files path is different on 32- and 64-bit machines.
$Script:ProgramFilesPath = GetProgramFilesPath
# SharePoint assemblies that can be referenced from SharePoint projects.
# If you need more assemblies, add them here.
$Script:SharePoint14ReferenceAssemblies = @(
"Microsoft.Office.Policy.dll",
"Microsoft.Office.Server.dll",
"C:\Windows\Assembly\GAC_64\Microsoft.Office.Server.Search\14.0.0.0__71e9bce111e9429c\Microsoft.Office.Server.Search.dll",
"Microsoft.Office.Server.UserProfiles.dll",
"Microsoft.Office.Workflow.Feature.dll",
"C:\Windows\assembly\GAC_MSIL\Microsoft.Office.Workflow.Feature\14.0.0.0__71e9bce111e9429c\Microsoft.Office.Workflow.Feature.dll",
"Microsoft.SharePoint.Client.dll",
"Microsoft.SharePoint.Client.Runtime.dll",
"Microsoft.SharePoint.Client.ServerRuntime.dll",
"Microsoft.SharePoint.dll",
"Microsoft.SharePoint.IdentityModel.dll",
"Microsoft.SharePoint.Linq.dll",
"Microsoft.SharePoint.Portal.dll",
"Microsoft.SharePoint.Publishing.dll",
"C:\Windows\Assembly\GAC_64\Microsoft.SharePoint.Search\14.0.0.0__71e9bce111e9429c\Microsoft.SharePoint.Search.dll",
"Microsoft.SharePoint.Security.dll",
"Microsoft.SharePoint.Taxonomy.dll",
"Microsoft.SharePoint.WorkflowActions.dll",
"Microsoft.Web.CommandUI.dll",
"System.Web.DataVisualization.dll"
)
# Destination path where SharePoint14 assemblies will be copied
$Script:SharePoint14ReferenceAssemblyPath = Join-Path $ProgramFilesPath "Reference Assemblies\Microsoft\SharePoint14"
# Folder where we collect assemblies and use as a source for installation
$Script:FilesFolder = "Files"
$Script:FilesPath = Join-Path $MyScriptDirectory $FilesFolder
# Path to .NET Framework 2.0 GAC
$Script:Gac20Path = Join-Path $Env:SystemRoot "Assembly"
# Path to .NET Framework 4.0 GAC
$Script:Gac40Path = Join-Path $Env:SystemRoot "Microsoft.NET\Assembly"
# SharePoint project MSBuild extensions.
$Script:MSBuildSharePointTools = @(
"Microsoft.VisualStudio.SharePoint.targets",
"Microsoft.VisualStudio.SharePoint.Tasks.dll"
)
# SharePoint project MSBuild extensions path.
$Script:MSBuildSharePointToolsPath = Join-Path $ProgramFilesPath "MSBuild\Microsoft\VisualStudio\v10.0\SharePointTools"
# SharePoint project assemblies required to create WSP files.
$Script:SharePointProjectAssemblies = @(
"Microsoft.VisualStudio.SharePoint.dll",
"Microsoft.VisualStudio.SharePoint.Designers.Models.dll",
"Microsoft.VisualStudio.SharePoint.Designers.Models.Features.dll",
"Microsoft.VisualStudio.SharePoint.Designers.Models.Packages.dll"
)
# Assemblies required for DSL. It is a dependency of the SharePoint Tools model assemblies.
# They are present on TFS 2010 Build. We need them only for TFS 2008 Build.
$Script:DslAssemblies = @(
"Microsoft.VisualStudio.Modeling.Sdk.10.0.dll"
)
# Name of the gacutil config file.
$Script:GacUtilConfigFileName = "gacutil.exe.config"
# Files needed to install assemblies to the GAC on TFS build machine.
$Script:GacUtilFiles = @(
"gacutil.exe",
$GacUtilConfigFileName
)
# Path where the GacUtils.exe can be found on the development machine
$Script:GacUtilFilePath = Join-Path $ProgramFilesPath "Microsoft SDKs\Windows\v7.0A\Bin\NETFX 4.0 Tools"
# TfsBuildService.exe.config file name to update MSBuildPath for TFS 2008
$Script:TfsBuildServiceConfigFileName = "TfsBuildService.exe.config"
# TfsBuildService.exe.config full file path to update MSBuildPath for TFS 2008
$Script:TfsBuildServiceConfigFilePath = Join-Path $ProgramFilesPath "Microsoft Visual Studio 9.0\Common7\IDE\PrivateAssemblies\$TfsBuildServiceConfigFileName"
}
#==============================================================================
# Top-level script routines
#==============================================================================
# Install SharePoint project files on TFS build server
function InstallSharePointProjectFiles() {
WriteText "Installing SharePoint project files for TFS Build."
WriteText ""
WriteText "Checking that the .Net Framework 4.0 is installed:"
WriteText "Found .Net Framework version $(GetDotNet40Version)"
WriteText ""
if (TestSharePoint14) {
WriteText "SharePoint 14 is installed on this machine."
WriteText "Skipping installation of SharePoint 14 reference assemblies."
WriteText ""
} else {
WriteText "Copying the SharePoint reference assemblies:"
$SharePoint14ReferenceAssemblies | CopyFileToFolder $SharePoint14ReferenceAssemblyPath
WriteText ""
WriteText "Setting the SharePoint reference assemblies path in the registry:"
AddSharePoint14ReferencePathToRegistry
WriteText ""
}
WriteText "Copying the SharePoint project MSBuild extensions:"
$MSBuildSharePointTools | CopyFileToFolder $MSBuildSharePointToolsPath
WriteText ""
WriteText "Installing the SharePoint project assemblies in the GAC:"
FixGacUtilConfigVersion
$SharePointProjectAssemblies | InstallAssemblyToGac40
WriteText ""
WriteText "Installing the DSL assemblies in the GAC:"
$DslAssemblies | InstallAssemblyToGac40 -SkipIfExists
WriteText ""
WriteText "Fixing MSBuildPath in $TfsBuildServiceConfigFileName for TFS 2008:"
FixTfsBuildServiceConfigMSBuildPath
WriteText ""
WriteText "Installation is complete."
WriteText ""
}
# Collect SharePoint project files on developement machine for TFS build server.
function CollectSharePointProjectFiles() {
WriteText "Collecting SharePoint project files for TFS Build."
WriteText ""
WriteText "Checking that the .Net Framework 4.0 is installed:"
WriteText "Found .Net Framework version: $(GetDotNet40Version)"
WriteText ""
WriteText "Creating the $FilesFolder directory:"
$FilesPathInfo = [System.IO.Directory]::CreateDirectory($FilesPath)
WriteText $FilesPathInfo.FullName
WriteText ""
WriteText "Collecting the DSL assemblies:"
$DslAssemblies | CopyFileFromFolder $Gac40Path -Recurse
WriteText ""
WriteText "Collecting the SharePoint reference assemblies:"
$SharePoint14ReferenceAssemblies | CopyFileFromFolder $Gac20Path -Recurse
WriteText ""
WriteText "Collecting the SharePoint project MSBuild extensions:"
$MSBuildSharePointTools | CopyFileFromFolder $MSBuildSharePointToolsPath
WriteText ""
WriteText "Collecting the SharePoint project assemblies:"
$SharePointProjectAssemblies | CopyFileFromFolder $Gac40Path -Recurse
WriteText ""
WriteText "Collecting the gacutil.exe files:"
$GacUtilFiles | CopyFileFromFolder $GacUtilFilePath
WriteText ""
WriteText "Colection is complete."
WriteText ""
}
# Writes instructions how to use the script.
# If -Quiet flag is provided it throws an exception.
function WriteHelp() {
if ($Quiet) {
throw "Specify either the -Install or -Collect parameter."
} else {
Write-Host ""
Write-Host "This script collects and installs the files to build SharePoint projects on a TFS build server (2010 or 2008)."
Write-Host ""
Write-Host "Parameters:"
Write-Host " -Collect - Collect files into the $FilesFolder folder on a development machine."
Write-Host " -Install - Install files from the $FilesFolder folder on a TFS build server."
Write-Host " -Quiet - Suppress messages. Errors will still be shown."
Write-Host ""
Write-Host "Usage:"
Write-Host ""
Write-Host " .\$MyScriptFileName -Collect"
Write-Host " - Collects files into the $FilesFolder folder on a development machine."
Write-Host ""
Write-Host " .\$MyScriptFileName -Install"
Write-Host " - Installs files from the $FilesFolder folder on a TFS build server."
Write-Host ""
}
}
#==============================================================================
# Utility functions
#==============================================================================
# Writes to Host if -Quiet flag is not provided
function WriteText($Value) {
if (-Not $Quiet) {
Write-Host $Value
}
}
# Gets the Program Files (x86) path
function GetProgramFilesPath() {
if (TestWindows64) {
return ${Env:ProgramFiles(x86)}
} else {
return $Env:ProgramFiles
}
}
# Installs assembly to the GAC
function InstallAssemblyToGac40([switch]$SkipIfExists) {
begin {
$GacUtilCommand = Join-Path $FilesPath "gacutil.exe"
}
process {
$FileName = $_
if ($SkipIfExists -and (TestAssemblyInGac40 $FileName)) {
WriteText "Assembly $FileName is already in the GAC ($Gac40Path)."
WriteText "Skipping installation in the GAC."
return
}
$FileFullPath = Join-Path $FilesPath $FileName
& "$GacUtilCommand" /i "$FileFullPath" /nologo
# Verify that assembly was installed to the GAC
if (-not (TestAssemblyInGac40 $FileName)) {
throw "Assembly $FileName was not installed in the GAC ($Gac40Path)"
}
WriteText "$FileName [is installed in ==>] GAC 4.0"
}
}
# Test if the assembly file name is already in the GAC
function TestAssemblyInGac40($AssemblyFileName) {
$FileInfo = Get-ChildItem $Gac40Path -Recurse | Where { $_.Name -eq $AssemblyFileName }
return ($FileInfo -ne $null)
}
# Copies file from the specified path or its sub-directory to the $FilesPath
function CopyFileFromFolder([string]$Path, [switch]$Recurse) {
process {
$SourcePath = $_
$FileName = [System.IO.Path]::GetFileName($_)
$DestinationPath = Join-Path $FilesPath $FileName
if (-Not (Test-Path $DestinationPath))
{
# Check if a full file path has been provided as the source
if (-not (Test-Path $SourcePath))
{
$FileInfo = Get-ChildItem $Path -Recurse:$Recurse | Where { $_.Name -eq $FileName }
if ($FileInfo -eq $null) {
throw "File $FileName was not found in $Path"
}
if ($FileInfo -is [array]) {
WriteText "Multiple files found matching search critiera of '$FileName'"
foreach ($match in $FileInfo)
{
WriteText $match.FullName
}
throw "Multiple instances of $FileName were found in $Path"
}
$SourcePath = $FileInfo.FullName
}
Copy-Item $SourcePath $FilesPath
WriteText "$($SourcePath) [was copied to ==>] $FilesPath"
}
else
{
WriteText "$($DestinationPath) has already been identified, harvesting was skipped"
}
}
}
# Copies file to the specified path from the $FilesPath
function CopyFileToFolder([string]$Path) {
begin {
# Ensure that the folder exists
$null = [System.IO.Directory]::CreateDirectory($Path)
}
process {
# Get just the file name of the current context
$FileName = [System.IO.Path]::GetFileName($_)
$FileInfo = Get-ChildItem (Join-Path $FilesPath $FileName)
if ($FileInfo -eq $null) {
throw "File $FileName was not found in $FilesPath"
}
Copy-Item $FileInfo.FullName $Path
WriteText "$($FileInfo.FullName) [was copied to ==>] $Path"
}
}
# Adds folder with SharePoint reference libraries to Registry to be found by MSBuild
function AddSharePoint14ReferencePathToRegistry() {
$RegistryValue = $SharePoint14ReferenceAssemblyPath + "\"
if (TestWindows64) {
$RegistryPath = "HKLM:\SOFTWARE\Wow6432Node\Microsoft\.NETFramework\v2.0.50727\AssemblyFoldersEx\SharePoint14"
} else {
$RegistryPath = "HKLM:\SOFTWARE\Microsoft\.NETFramework\v2.0.50727\AssemblyFoldersEx\SharePoint14"
}
# Do not set value if it is already exists and has the same value
if (-Not (Test-Path $RegistryPath))
{
WriteText "Writing new registry key '$RegistryPath' as '$RegistryValue'"
$null = New-Item -ItemType String $RegistryPath -Value $RegistryValue
}
else
{
if (-Not ((Get-ItemProperty $RegistryPath)."(default)" -Eq $RegistryValue))
{
WriteText "Updating registry key '$RegistryPath' to '$RegistryValue'"
Set-Item -Path $RegistryPath -Value $RegistryValue
}
else
{
WriteText "Registry key '$RegistryPath' ignored as it already has the correct value of '$RegistryValue'"
}
}
}
# Returns full path for the .Net 4.0 framework installation
function GetDotNet40Directory() {
# Find a folder in Microsoft.NET that starts with 'v4.0'
$DirectoryInfo = Get-ChildItem (Join-Path $Env:SystemRoot "Microsoft.NET\Framework") `
| Where { $_ -is [System.IO.DirectoryInfo] } `
| Where { $_.Name -like 'v4.0*' }
if ($DirectoryInfo -eq $null) {
throw ".Net 4.0 is not found on this machine."
}
return $DirectoryInfo
}
# Returns version of installed .Net 4.0 framework
function GetDotNet40Version() {
return (GetDotNet40Directory).Name
}
# Returns $true if this is 64-bit version of Windows
function TestWindows64() {
return (Get-WmiObject Win32_OperatingSystem | Select OSArchitecture).OSArchitecture.StartsWith("64")
}
# Returns $true if machine has SharePoint 14 installed
function TestSharePoint14() {
return Test-Path "HKLM:\SOFTWARE\Microsoft\Shared Tools\Web Server Extensions\14.0"
}
# Changes .Net framework version in gacutil.exe.config to match current .Net framework version.
# It is required for gacutil.exe to work.
function FixGacUtilConfigVersion() {
$ConfigFilePath = Join-Path $FilesPath $GacUtilConfigFileName
if (-not (Test-Path $ConfigFilePath)) {
throw "File $ConfigFilePath was not found"
}
$DotNet40Version = GetDotNet40Version
$ConfigDotNet40Version = GetGacUtilConfigVersion
if ($DotNet40Version -ne $ConfigDotNet40Version) {
# Create a backup file
$ConfigBackupFilePath = $ConfigFilePath + ".bak"
Copy-Item $ConfigFilePath $ConfigBackupFilePath
# Make the file writable
$ConfigFileInfo = Get-ChildItem $ConfigFilePath
$ConfigFileInfo.IsReadOnly = $false
# Read the file content, change the version and override the original file.
# Need a variable for content to avoid simultaneous read-write of the same file.
$ConfigFileContent = Get-Content $ConfigFilePath
$null = $ConfigFileContent `
| ForEach { $_ -replace '"v4\.0.*?"', """$DotNet40Version""" } `
| Out-File $ConfigFilePath -Encoding UTF8
WriteText ".Net version in file $ConfigFilePath changed from '$ConfigDotNet40Version' to '$(GetGacUtilConfigVersion)'"
}
}
# Returns version of .Net Framework stored in gacutil.exe.config
function GetGacUtilConfigVersion() {
$ConfigFilePath = Join-Path $FilesPath $GacUtilConfigFileName
$ConfigVersionMatch = Get-Content $ConfigFilePath | Where { $_ -match '"(v4\.0.*?)"' }
if ($ConfigVersionMatch -eq $null) {
throw "No version info found in file $ConfigFilePath"
}
return $Matches[1]
}
# Changes MSBuild .Net framework version in TfsBuildService.exe.config to
# match current .Net framework version.
function FixTfsBuildServiceConfigMSBuildPath() {
if (-not (Test-Path $TfsBuildServiceConfigFilePath)) {
WriteText "$TfsBuildServiceConfigFilePath was not found."
WriteText "This is needed only for TFS 2008."
return
}
$DotNet40Directory = (GetDotNet40Directory).FullName
$ConfigMSBuildPath = GetTfsBuildServiceConfigMSBuildPath
if ($DotNet40Directory -ne $ConfigMSBuildPath) {
# Create a backup file
$TfsBuildServiceConfigBackupFilePath = $TfsBuildServiceConfigFilePath + ".bak"
Copy-Item $TfsBuildServiceConfigFilePath $TfsBuildServiceConfigBackupFilePath
# Make the file writable
$ConfigFileInfo = Get-ChildItem $TfsBuildServiceConfigFilePath
$ConfigFileInfo.IsReadOnly = $false
# Read the file content, change the MSBuildPath and override the original file.
# Need a variable for content to avoid simultaneous read-write of the same file.
$ConfigFileContent = Get-Content $TfsBuildServiceConfigFilePath
$null = $ConfigFileContent `
| ForEach { $_ -replace 'key="MSBuildPath"\s+value=".*?"', "key=""MSBuildPath"" value=""$DotNet40Directory""" } `
| Out-File $TfsBuildServiceConfigFilePath -Encoding UTF8
WriteText "MSBuildPath in file $TfsBuildServiceConfigFilePath changed from '$ConfigMSBuildPath' to '$(GetTfsBuildServiceConfigMSBuildPath)'"
WriteText ""
Restart-Service 'VSTFBUILD'
WriteText "'VSTFBUILD' service was restarted to apply changes in the $TfsBuildServiceConfigFileName file"
}
}
# Returns the .Net Framework path stored in TfsBuildService.exe.config
function GetTfsBuildServiceConfigMSBuildPath() {
$ConfigVersionMatch = Get-Content $TfsBuildServiceConfigFilePath `
| Where { $_ -match 'key="MSBuildPath"\s+value="(.*?)"' }
if ($ConfigVersionMatch -eq $null) {
throw "No MSBuildPath key was found in file $TfsBuildServiceConfigFilePath"
}
return $Matches[1]
}
#==============================================================================
# Main script code
#==============================================================================
InitializeScriptVariables
if ($Install) {
InstallSharePointProjectFiles
} elseif ($Collect) {
CollectSharePointProjectFiles
} else {
WriteHelp
}
Tags: TFS, WiX, TeamBuild