Skip to main content

Posts

Upgrading your SSIS Management Framework: Part 3

At this point, you understand the options for moving an SSIS framework to the latest version of SSIS, and you've upgraded the logging portion of the framework using a hybrid approach.  The final step in the framework upgrade is handling your configurations.  Let's walk through an existing configuration implementation and how you can upgrade it by combining your existing implementation with the standard SSIS framework. Overview A typical "old-school" configuration scheme is described in the SSIS PDS book or in this blog post here: http://jessicammoss.blogspot.com/2008/05/ssis-configuration-to-configuration-to.html .  Starting in SSIS 2012, the configuration scheme uses environments and parameters when using the Project Deployment Model, as discussed here: http://msdn.microsoft.com/en-us/library/hh213290(v=sql.110).aspx . In both scenarios, the core ideas in a configuration scheme are: Provide the ability to move packages through environments without ...

Upgrading your SSIS Management Framework: Part 2

Based on Part 1 of Upgrading your SSIS Management Framework , you’ve decided to go with a hybrid approach for your framework.  The hybrid approach which will use some components of the custom framework (this post will use the framework provided in SSIS PDS , but the concepts are applicable to any custom framework) and also utilize the standard SSIS framework.  This allows you to tie your existing package ecosystem with the latest and greatest built-in framework. Let’s talk through an overview of what we’re going to do and then explain each of the steps needed to implement it. Overview When it comes down to it, we need to accomplish two main things for this hybrid approach: tie our logging tables together and tie our configuration tables together.  When it comes to logging, each system has its own important identifier (ID) that can get you to anything else in the system.  The important ID in the custom SSIS framework is the PackageLogID, and the important ID in th...

Upgrading your SSIS Management Framework: Part 1

Background Before SQL Server 2012, SQL Server Integration Services (SSIS) had no built-in logging, auditing, and configuration framework.  All of the pieces were available to build your own, but everyone ended up doing that just a little bit differently.  Most of us consultants came up with our own variation to implement at client sites and ensure that all of those functions at that one client were the same.  I'm especially proud of the framework that Rushabh Mehta and I developed that is published in Microsoft SQL Server Integration Services: Problem, Design, Solution (SSIS PDS) and implemented by many others as well. Along came SSIS 2012, when Microsoft realized this "multiple-different frameworks" spread was happening, and thought "how cool would it be if we could standardize the framework so ALL our clients have the same one".  This would not only reduce initial development time of the framework, but also ensure that upgrades and future ...

Where is my BI Development Tool?

" The development tool for SQL Server business intelligence packages is missing! " says almost every developer who installs SQL Server 2014. It's okay, don't panic.  Microsoft decided to separate the installer for the server and the installer for the development environment.  Unfortunately, the next statement by almost every developer who installs SQL Server 2014 is " There are MULTIPLE SQL Server Data Tools?!? ".  Also not a problem, let's talk about the difference options and how to get the correct software on your machine. Option 1 is SQL Server Data Tools (the original), which is a template for Visual Studio that allows you to create and store information on databases and database objects.  This tool is part of Visual Studio.  For more information, see: http://msdn.microsoft.com/en-us/data/hh297027 . Option 2/3 are SQL Server Data Tools - Business Intelligence, which contain the templates for SSIS, SSAS, and SSRS (the standard BI to...

Eek! Starting as a Regular Full-Time Employee

Well, I jumped into the career deep end last week.  I started my first-ever job as a regular full-time employee.  This week contained a mixture of emotions for me: scared, nervous, but overall - EXCITEMENT!  It's been a long road, but I'm very happy with where I've come and where I'm going. I started with a consulting company right out of college.  Back then, graduating with a computer science degree pretty much meant you knew a little bit about a lot, but had no deep knowledge in any area.  So working on a little bit of everything to gain some knowledge in a consulting company seemed like a perfect fit!  I still remember during my interview, the interviewee said "You'll be assigned a project over the weekend, buy a book on the technology, and by the time you arrive on Monday, you need to be an expert".  While we all know that won't exactly work, I was able to learn SO much by hopping around and trying different technologies, industries, and systems....

Happy New Year Resolutions

Happy 2013! 2012 was a great year, and I hope that 2013 will be even better. To assist, I decided to create resolutions this year.  I don't usually create resolutions because I believe that they aren't maintainable.  Too often we hear of the gym membership that expired after a month due to disuse, the 20 pounds to lose that became 2 pounds, the bad habit that we were going to break... tomorrow… But what I do like about new year resolutions is that the new year is a fresh start, a way to wipe the slate clean and wish for a better and brighter future.  To make sure my resolutions don't become those drift into the ether, I need specific tasks that will force me to accomplish this. So with that optimistic outlook, my professional resolutions for 2013: Blog twice a month. This will be my hardest resolution based on past history. ;) Tasks: Tell people I'm going to do this (DONE!) Create an initial list of blog topics and dates - is there anything ...

PASS Summit 2012

For the fifth year in a row, I am excited to present at the PASS Summit in Seattle, WA.  The PASS Summit is the premier SQL Server conference in the United States for anyone interested in SQL Server, SQL Server Business Intelligence, and Microsoft data technologies.  I always learn something new when I attend, and I enjoy catching up with old friends.  If you’re a new friend that I haven’t met yet, please introduce yourself to me at one of the following locations: 11/5/2012 8:30am-4:30pm SSIS Design Patterns pre-conference session 11/5/2012 6:00pm-9:00pm Networking Dinner at Gordon Biersch 11/6/2012 6:30pm-8:00pm PASS Summit 2012 Welcome Reception 11/7/2012 11:30am-12:30pm Book Signing – PASS Bookstore 11/8/2012 1:00pm-2:00pm & 3:00pm-4:00pm Book Signing – Apress Booth 11/9/2012 9:45am-11:00am Jessica’s Session: “Getting Reports on Your Schedule” 11/9/2012 11:30am-12:30pm Birds of a Feather table: Data Warehousing Hope to see you then!