Showing posts with label load. Show all posts
Showing posts with label load. Show all posts

Friday, March 30, 2012

Long time SSIS package loading

I load SSIS package using following code:

Application app = new Application();
Package pac = app.LoadFromSqlServer(packageName, serverName, null, null, null);

For simple package containing 2 tasks this code executes about 20 seconds.
If I load old version (SQL2K) package from SQL2000 then it takes 5 seconds.

Is any way to increase loading speed for SSIS packages?

Do you have SSIS service running? The service caches SSIS component information; in the absense of the service it may take long time (although it is usually 2-3 seconds on reasonable hardware) to enumerate them when loading the package.|||

Thank you Michael.
I carry out additional experiments with realworld package (contains 11 tasks) at another computer.
When I start this experiment I have to wait 1.5 minutes to load package every time. Then I examine if SSIS running. I discover SSIS don't running after SP1 was applied (widely known SP1 bug). I installed post SP1 cumulative hotfixes and continue investigation. Now package loading first time during 30 seconds. When I start it second time it takes about 2 seconds. This is good result. But is there ability to increase loading speed at first time? Will be loading perfomance improved if such delay caused internal implementation of SSIS?

|||Much of the time on the initial load of the package is due to validation of the metadata of each of your tasks. In order to speed of the initial load, you could change the DelayValidation property of your package and all tasks to true. However, that's not really best practices.|||

Thank you Martin
This helps.

BTW, BOL says:
"Validating the package before it runs is a way of finding some errors before execution starts. However, it processes the package to find errors, and if no errors are found, the package runs. Because this goes through the package two times, validating a package increases the amount of processing for the package, so should be used only when necessary."

|||

Alexey Rokhin wrote:

... I discover SSIS don't running after SP1 was applied (widely known SP1 bug). I installed post SP1 cumulative hotfixes and continue investigation. Now package loading first time during 30 seconds...

The bug you quote is described in http://support.microsoft.com/kb/918644. While the hotfix fixes the service startup failure, it can't fix the cause of the problem - long time to start the service due to network configuration that timeouts requests to CRL. So the service still takes 30+ seconds to start (which caused to fail before the hotfix, this later part is now fixed).

To avoid this 30+ delay you should either change the SSIS service to autostart (thus moving the delay to the computer boot time), or better fix the network configuration as described in the KB (although it might be very specific to your environment) to either allow access to CRL, or to quickly fail and return failure status to an application accessing CRL.

|||

Thank you, Michael.
In production environment SSIS service will autostart.

|||

Alexey,

IMHO, a good practice is defining a Events class and so, debugging the code and so you'll find issues faster, i.e with F11...

pkg = app.LoadFromSqlServer(ObjSSIS.sRutaDts & "\" & ObjSSIS.sSSISName, ObjSSIS.sServer, "usrSSIS", "ninot", EventsSSIS)

Public Class EventsSSIS

OnError

OnPreExecute

..

..

sql

Wednesday, March 28, 2012

long running packages

I need to execute a long running package (it takes about 16 hours to finish) to load a data warehouse for the first time with all historical data. This package it's a master package and execute other packages; I log the start time and the finish time of the package in a table to manage future incremental loads.

I executed the package on sql server where it is saved, but after 8 hours it was running, a new package was started automatically. Then two more packages started .. each every two hours.

I set the MaxConcorrentExecutable = 4, this could affect this strange behavoir ?

Anyone could imagine wath happened ?

Thanks

Cosimo

cosimog wrote:

I need to execute a long running package (it takes about 16 hours to finish) to load a data warehouse for the first time with all historical data. This package it's a master package and execute other packages; I log the start time and the finish time of the package in a table to manage future incremental loads.

I executed the package on sql server where it is saved, but after 8 hours it was running, a new package was started automatically. Then two more packages started .. each every two hours.

I set the MaxConcorrentExecutable = 4, this could affect this strange behavoir ?

Anyone could imagine wath happened ?

Thanks

Cosimo

What mechanism are you using to start the package?

Packages will not start executing unless you tell them to.

MaxConcurrentExecutables is completely irrelevant here by the way.

-Jamie

|||

Solved.

It was just a bug ... thank

Cosimo

Friday, March 23, 2012

logshipping load failure

Hi Guys,
I implemented log shipping but if database is open during
load the restore is failing.
i think i selected "terminate users in database" option.
how i can confirm whether i selected this option? and if
not how can i change this.
THNKS
BIJU
Biju,
the easiest way to check and change this property is to edit the maintenance
plan, goto the logshipping tab and edit, on the initialize tab select
'Terminate Users in Database'.
HTH,
Paul Ibison

LogShipping Copy and Load Question

Hi,
I have established a LogShipping plan with Secondary
Server DB set as Standby, 15 minutes interval of Backup
Log, Load and Restore. Questions:
(1) Inside Log Shipping History, it seems that the Copy
will always copy NEWER Log (in my case, 15 minutes later,
eg. 1815), and Load will always Load OLDER Log (in my
case, 15 minuutes earlier eg. 1800). How can I resolve
this?
(2) Most importantly, The Logshipping will have errors
after a while and it reaches a stage where NO file(s) will
be processed and "Last File" in Log Shipping History
always remains the same file (Eg. ...200407090615.TRN). I
suspect it is all related to the frequency that I set.
I just find it hard to maintain a good Log Shipping plan
which does not require close monitoring.
I would appreciate any help for me here. Thanks a lot in
advance.
Tom
Tom,
making the load frequency every 5 mins should solve the issues you are
experiencing.
I always have a more frequent load than copy to prevent backlogs of the log
files.
HTH,
Paul Ibison
sql

Monday, March 19, 2012

Logon Error ?

The following error is logged in SQL Server 2005 Logfile. Could anyone
explain why this error is happening ?
Message
The server was unable to load the SSL provider library needed to log in; the
connection has been closed. SSL is used to encrypt either the login sequence
or all communications, depending on how the administrator has configured the
server. See Books Online for information on this error message: 0x6d.
[CLIENT: <named pipe>]Hi,
Have you installed an SSL certificate on the SQL Server?
If not then remove any configuration you may have on the server to force
encryption for connections (SQL Server Configuration Manager). You should
also remove any configuration on the client computers requiring them to
connect using encryption (SQL Native Client Configuration).
In BOL, please check
ms-help://MS.SQLCC.v9/MS.SQLSVR.v9.en/udb9/html/e1e55519-97ec-4404-81ef-881d
a3b42006.htm
Nathan H. Omukwenyi
"swami" <swami@.discussions.microsoft.com> wrote in message
news:F4FC882D-DE26-4D8A-AACA-3DC7CF1C5F70@.microsoft.com...
> The following error is logged in SQL Server 2005 Logfile. Could anyone
> explain why this error is happening ?
> Message
> The server was unable to load the SSL provider library needed to log in;
> the
> connection has been closed. SSL is used to encrypt either the login
> sequence
> or all communications, depending on how the administrator has configured
> the
> server. See Books Online for information on this error message: 0x6d.
> [CLIENT: <named pipe>]|||As far as we can see - encryption is not set anywhere, either on the
server or client.
any other clues ?
"Nathan H. Omukwenyi" wrote:

> Hi,
> Have you installed an SSL certificate on the SQL Server?
> If not then remove any configuration you may have on the server to force
> encryption for connections (SQL Server Configuration Manager). You should
> also remove any configuration on the client computers requiring them to
> connect using encryption (SQL Native Client Configuration).
> In BOL, please check
> ms-help://MS.SQLCC.v9/MS.SQLSVR.v9.en/udb9/html/e1e55519-97ec-4404-81ef-88
1da3b42006.htm
> Nathan H. Omukwenyi
>
>
> "swami" <swami@.discussions.microsoft.com> wrote in message
> news:F4FC882D-DE26-4D8A-AACA-3DC7CF1C5F70@.microsoft.com...
>
>

Logon Error ?

The following error is logged in SQL Server 2005 Logfile. Could anyone
explain why this error is happening ?
Message
The server was unable to load the SSL provider library needed to log in; the
connection has been closed. SSL is used to encrypt either the login sequence
or all communications, depending on how the administrator has configured the
server. See Books Online for information on this error message: 0x6d.
[CLIENT: <named pipe>]Hi,
Have you installed an SSL certificate on the SQL Server?
If not then remove any configuration you may have on the server to force
encryption for connections (SQL Server Configuration Manager). You should
also remove any configuration on the client computers requiring them to
connect using encryption (SQL Native Client Configuration).
In BOL, please check
ms-help://MS.SQLCC.v9/MS.SQLSVR.v9.en/udb9/html/e1e55519-97ec-4404-81ef-881da3b42006.htm
Nathan H. Omukwenyi
"swami" <swami@.discussions.microsoft.com> wrote in message
news:F4FC882D-DE26-4D8A-AACA-3DC7CF1C5F70@.microsoft.com...
> The following error is logged in SQL Server 2005 Logfile. Could anyone
> explain why this error is happening ?
> Message
> The server was unable to load the SSL provider library needed to log in;
> the
> connection has been closed. SSL is used to encrypt either the login
> sequence
> or all communications, depending on how the administrator has configured
> the
> server. See Books Online for information on this error message: 0x6d.
> [CLIENT: <named pipe>]|||As far as we can see - encryption is not set anywhere, either on the
server or client.
any other clues ?
"Nathan H. Omukwenyi" wrote:
> Hi,
> Have you installed an SSL certificate on the SQL Server?
> If not then remove any configuration you may have on the server to force
> encryption for connections (SQL Server Configuration Manager). You should
> also remove any configuration on the client computers requiring them to
> connect using encryption (SQL Native Client Configuration).
> In BOL, please check
> ms-help://MS.SQLCC.v9/MS.SQLSVR.v9.en/udb9/html/e1e55519-97ec-4404-81ef-881da3b42006.htm
> Nathan H. Omukwenyi
>
>
> "swami" <swami@.discussions.microsoft.com> wrote in message
> news:F4FC882D-DE26-4D8A-AACA-3DC7CF1C5F70@.microsoft.com...
> > The following error is logged in SQL Server 2005 Logfile. Could anyone
> > explain why this error is happening ?
> >
> > Message
> > The server was unable to load the SSL provider library needed to log in;
> > the
> > connection has been closed. SSL is used to encrypt either the login
> > sequence
> > or all communications, depending on how the administrator has configured
> > the
> > server. See Books Online for information on this error message: 0x6d.
> > [CLIENT: <named pipe>]
>
>