SSIS File Naming
Dec 27, 2007
I have created a package that creates a CSV file by exporting data from SQL Server 2005 sp2.
I am looking to have the process of naming the files automated so i don;t need to change the package every time i need the files generated.
is there away that SSIS can automatically name the CSV files using the database name that the data is coming from?
eg.
Database Filename
DB1 DB1.File.csv
DB2 DB2.File.csv
where file remains constant.
View 4 Replies
ADVERTISEMENT
Mar 10, 2006
I've just started using SQL Server 2005 Integration Services and
I've come up against a situation where I need to name output files
dynamically (i.e. based on a timestmap). Looking through this
newsgroup, and other web resources it looks like my only option is to use a Script Task/ActiveX Script Task to rename the file after it has
been created with a generic file name.
I was wondering if there was a different approach or if there was a way to pass in a variable to the file connection manager that I could append to the file name at run-time.
Thanks
Bill
View 7 Replies
View Related
Dec 17, 2007
Hi,
I am trying to import a SQL dataset run through SQL Execute task to an excel file.
I would like the excel file to be generated each night.
My question is
1. How would I dynamically name the excel file to be report_daterun?
2. Also I would like to automatically zip the file up can ssis do this as well?
thanks
View 1 Replies
View Related
Nov 29, 2013
We are using MSBuild with a custom activity to build and deploy ISPACs from SSDT BI 2012. We are building the ISPAC by calling the invoke process activity which inturn performs a build of the solution using devenv.exe.
All of this is working fine until we have solutions/ projects (dtproj) with complex names. We have a solution named Company.Project.SSIS.Package.sln when we do a build it creates an ISPAC as expected however it is named incorrectly - Company.Project.ispac.
When we subsequently deploy the ISPAC, it creates a project in the catalog called Company.Project.SSIS again this is wrong. This also happend if i perform a manual build in VS2012.
The issue is, the automated deployment of the ISPAC fails as it is looking for a file with a different name. Is there a way of changing these settings?
View 7 Replies
View Related
May 13, 2008
Hello Experts,
I am createing one task (user control) in SSIS. I have property grid in my GUI and 2 buttons (OK & Cancle).
PropertyGrid has Properties like SourceConnection, OutputConnection etc....right now I am able to populate Connections in list box next to Source and Output Property.
Now my question to you guys is depending on Source Connection it should read that text file associated with connection manager. After validation it should pick header (first line of text file bases on record type) and write it into new file when task is executed. I have following code for your reference. Please let me know I am going in right direction or not..
What should go here ?
->Under Class A
public override DTSExecResult Execute(Connections connections, VariableDispenser variableDispenser, IDTSComponentEvents componentEvents, IDTSLogging log, object transaction)
{
//Some code to read file and write it into new file
return DTSExecResult.Success;
}
public const string Property_Task = "CustomErrorControl";
public const string Property_SourceConnection = "SourceConnection";
public void LoadFromXML(XmlElement node, IDTSInfoEvents infoEvents)
{
if (node.Name != Property_Task)
{
throw new Exception(String.Format("Invalid task element '{0}' in LoadFromXML.", node.Name));
}
else
{
try
{
_sourceConnectionId = node.Attributes.GetNamedItem(Property_SourceConnection).Value;
}
catch (Exception ex)
{
infoEvents.FireError(0, "LoadFromXML", ex.Message, "", 0);
}
}
}
public void SaveToXML(XmlDocument doc, IDTSInfoEvents infoEvents)
{
try
{
// // Create Task Element
XmlElement taskElement = doc.CreateElement("", Property_Task, "");
doc.AppendChild(taskElement);
// // Save source FileConnection
XmlAttribute sourcefileAttribute = doc.CreateAttribute(Property_SourceConnection);
sourcefileAttribute.Value = _sourceConnectionId;
taskElement.Attributes.Append(sourcefileAttribute);
}
catch (Exception ex)
{
infoEvents.FireError(0, "SaveXML", ex.Message, "", 0);
}
}
In UI Class there is OK Click event.
private void btnOK_Click(object sender, EventArgs e)
{
try
{
_taskHost.Properties[CustomErrorControl.Property_SourceConnection].SetValue(_taskHost, propertyGrid1.Text);
btnOK.DialogResult = DialogResult.OK;
}
catch (Exception ex)
{
Console.WriteLine(ex);
}
#endregion
}
View 10 Replies
View Related
May 2, 2007
I want to enumerate all *.xls and *.csv file. How to fill the Files box? I tried
*.xls, *.csv
*.xls *.csv
*.(xls|cvs)
all doesn't work
View 4 Replies
View Related
Oct 24, 2007
Hi all,
In a foreachloop, I am inserting records into a flat file which is working fine. But the thing is that as the file grows, it takes longer for it to locate the EOF(End of File) of the flat file so as to insert the records.
I have around 70-100 lines written to the file at each loop and there are more than 20k records to be looped. wihich means that at the end I should be having 1400k - 20000k line in the text file.
One solution would be to insert the records at the start of the file itself so that it does not has to lookup the EOF each time before writting.
Another would be to generate separate files and then merge it.
Any idea how can this can be done?
Beside this I have to zip the file and then SFTP to a given address.
Any suggestion or help would be welcome.
Rdgs
David
View 5 Replies
View Related
Jun 19, 2015
Historically I've always written a VB script to copy a file from a sharepoint library. I don't like this method because I have to input a username & password in the script and maintain a config file.
Yesterday I was playing around with using a file system task. The sharepoint file has a UNC path so why not? I created a simple test package with a single file system task that copies the sharepoint file (addressed via UNC) to another network location. Package runs fine locally.
I try running on our utility server but am getting a "The file name [SHAREPOINT UNC PATH] specified in the connection was not valid" error. Package is running with a proxy on the server and the proxy account has the same permissions to the sharepoint site (so far as I can tell) as me.
View 0 Replies
View Related
Dec 4, 2014
I am trying to create and later read a data file from a package deployed in SSISDB, but it is not reading it while it is successfully creating the file. The same package when run from the file system package, runs successfully. Generating ispac and deploying in SSISDB is running for infinite time. Is it a permission issue?
View 7 Replies
View Related
Aug 1, 2007
I need to build an asp.net/C# application to read values from an Excel spreadsheet. Once the values are read from the spreadsheet, the C# code will do some elementary statistics on the values read. Then the values read and their computations will be written to a sql server database.
My manager suggested that SSIS might be a good candidate technology for doing this type of work. Does that sound correct? My only hesitation with using SSIS is that I want to keep the application as simple as possible, so that the code can be more portable. Maybe might argument is not a good one, but maybe someone can help me out here.
Ralph
View 1 Replies
View Related
Jan 4, 2008
Dear Friends,
I store several configurations in the main database of my SSIS packages. I need to get the servername from a xml or txt file in order to get those configurations stored in my database.
How you think is the better way to do that?
Using a FlatFileSource to read the file and a script to save the value into a SSIS variable?
Using the package configuration I cant do that... maybe I dont know, but I can save the SSIS variale in the configuration file, but what I need is to do the inverse, read the configuration file and save the value in the SSIS variable.
How the best way you suggest?!
Regards!!
Thanks.
View 18 Replies
View Related
Oct 1, 2006
Hi,
I am pulling text files in gzip format from UNIX system. I want to unzip these files and then import data from these files into database using SSIS.
View 15 Replies
View Related
Sep 28, 2007
Hello, I have 2 tables: Articles and Users. These 2 tables are related by AuthorId (FK) in Articles and UserId (PK) in Users. My question is: should the use the same name for the 2 keys, i.e., UserId? Or it is normal to use AuthorId in Articles table and UserId in Users table. This makes more sense. Just a naming question. Thanks, Miguel
View 5 Replies
View Related
Jun 18, 2006
What does everyone think of this method?I have a ton of tables like User, Project etc. I use the SAME column names for each table. For an example, ID, Name, Status etc instead of UserID etc.Only for relationship naming will I use UserID.The reason I do this is from a OOP perspective.My dad often said that a table was a entitiy of an object and each record in the table was a instance of that object.
View 2 Replies
View Related
May 3, 2005
I have a function which is named like this:
CREATE FUNCTION [GEEKASPNET.Split]
How can I use it in my stored procedure:
UPDATE Tasks SET Status = 0
WHERE TaskID IN (SELECT CONVERT(int, Value) FROM [GEEKASPNET].Split(@Tasks,","))
This does not work and gives me that "unreconized function GeekASPNET.Split
View 5 Replies
View Related
Jan 2, 2001
I am using SQL Server 7 w/ SP2. This may seem silly, but I'm trying to re-name a DTS local package -- so far without success. Surely there's a way to do this. Also, where is DTS info stored? That is, how does SQL Server store package names and other details? Thanks!
View 1 Replies
View Related
Oct 12, 2000
Does anyone know if there is someway to rename a DTS package? Or can I go into the msdb database
and delete the old name?
Thanks for your help.
Dianne
View 3 Replies
View Related
Jan 31, 2005
Most of the programming I do is in Access. I like to use naming conventions for all my tables, queries, etc. I am now moving several databases to SQL Server. Does anyone know of a good resource for naming convetions in SQL Server. Website, book?
View 2 Replies
View Related
Aug 21, 2006
Hi all,
I wanted to ask for the naming conventions in SQL SERVER.as in case of pl/sql server we have ..name_of_package.name_of_procedure thats how we call the procedures i.e. owner of schema then name of package n then procedure name.....i want to ask you all how is it done in SQL SERVER..please try to reply as soon as possible,
i will b waiting for the replies,
regards
View 3 Replies
View Related
Mar 8, 2006
In our database tables are generated like
EMP_MASTER
DEPT_MASTER
like that. when we generate classes from database the class names are looking like
EmpMaster
DeptMaster
but for my classes that Master suffix is not required.
please solve my problem.
Thanks and Regards,
guru
View 4 Replies
View Related
May 8, 2006
Would like to know what naming convention you folks use.
What I need specifically is column naming conventions.
For instance, I have a table called 'lst_as400_srvr'. We could go with the vigorous:
CREATE TABLE lst_as400_srvr
(
as400_srvr_idintNOT NULLIDENTITY,
as400_srvr_namevarchar(128)NOT NULL,
as400_srvr_is_activebitNOT NULLDEFAULT 1
)
Or, I could loosen the rules a bit and go with:
CREATE TABLE lst_as400_srvr
(
idintNOT NULLIDENTITY,
namevarchar(128)NOT NULL,
is_activebitNOT NULLDEFAULT 1
)
I would lean towards the vigorous because it would be very obvious what data is being referenced by the name. In the loosened version, I could very easily have many tables with a 'id' column or a 'is_active' column.
Inversely, I would lean towards the loosened version because the names are a lot shorter and, thus, easier / faster to type.
I figure, if I'm going to learn a new standard, now's a good time to do so.
So, thoughts? Appreciate the help folks. :)
View 5 Replies
View Related
Jul 18, 2007
I'm creating a new database for an application that I wish to sell in the future. When we sell it the client will have the option to host is or have us host it. I want to create a name for the database that doesn't describe what the product is. I also want to be able to create new databases if we host it and those names be of a similar convention or subject. I was thinking each would be a Greek god, galaxy names or something along those lines. Does anyone have any suggestions?
Thanks,
Ryan
View 7 Replies
View Related
May 3, 2007
I'm coming from a MS Access background and so I'm very used to andcomfortable with the hungarian (Leszynski et al) naming conventions.However, I'm getting started into my first SQL Server Database andreally want to use the appropriate up to date standard namingconvention (ISO compliant).I think I have the general idea from raking though countlessconflicting sites and posts, but I'm a bit stuck on what to doregarding pk / fk namingFor example, in my MS Access world I would have two tables:tblOrders=======strOrderIDintCustomerIDdtOrderDate....tblCustomers==========intCustomerIDstrCustomerName....So what would the appropriate and most up-to-date and standard namingbe for SQL Server? My Guess:Orders=====Ord_Order_ID_PkOrd_Customer_ID_FkOrd_Order_Date....Customers========Cus_Customer_ID_PkCus_Customer_Name....How close (or far) am I from "Celko Proof" naming here?All help gratefully accepted!
View 9 Replies
View Related
Oct 4, 2007
When I schedule a DTS package as a Job and then look in the job step detail I am presented with the following line.
DTSRun /~Z0x3A2210EB05CE1F9968C82E............etc
This number means nothing to me and I presume it might be encoded or encrypted.
If I wanted to be sure that this code actually relates to the correct DTS package how can I check.
Is there a specific table that will hold that code that will relate it to the DTS package??
Cheers
Tom
View 1 Replies
View Related
Dec 27, 2007
I use data driven subscriptiosn to deliver the same report to 6 different customers. But each customer can see only his data. Reports are saved in a shared folder in xl version. Reports are saved like report_1,report_2 etc. Is there anyother way to name these reports without letting customer to change the name?
Thanks
View 4 Replies
View Related
Feb 26, 2007
Sorry if this seems trivial, but is it allowed to add hyphens in a physical server name?
eg: PC-01
Will this cause any errors (when connecting, etc)
Thanx.
View 1 Replies
View Related
Dec 5, 2007
Is there any standard naming convention for SQL Server that microsoft suggest it?
the same as naming guidlines in MSDN for designing libararies in .Net Framework.
View 4 Replies
View Related
Dec 20, 2003
I have to build a table Physicalcharacterics in sql.
Convention for naming a table
Would I name this table in sql server
tbl_User_PhysicalCharacterics.
My main parent table is tbl_User.
Is that too long of a name.
View 2 Replies
View Related
Nov 18, 2005
I noticed that a lot of my stuff is getting named dbo.XXXXXXX. Why is it happening and what does this mean?
View 4 Replies
View Related
Jun 10, 2006
We have two tables. Users and Projects and there is a many-to-many relationship.Ex. A user can be assigned into multiple projects.For the relationship table, should the table name be UserProjects or ProjectUsers?Also should it be singular or plural? (ex. UsersProjects or ProjectsUsers)?
View 2 Replies
View Related
Mar 31, 2000
Hi, can anyone help me with this strange problem?
I am trying to name a new SQL table, but I keep receiving a message that a table with this name already exists in the database. However, when I try to run a SELECT statement using that table, the error msg tells me the object does not exist,and it is not in the combobox of existing tables that can be added to a diagram.
Any clues would be appreciated, thanks !
View 2 Replies
View Related
Sep 22, 2000
Does anyone know if it is possible to create dynamically named tables from within a stored procedure? The goal is to append a unique identifier on the end of an otherwise static table name to allow for multiple incarnations of the table to exist concurrently while not interfering with each other. For example, we would like to create and use a temp table that is suffixed with a login name to or a timestamp to make it unique.
Is this possible?
View 6 Replies
View Related
Sep 2, 1998
I was wondering if there are generally accpeted naming standards for SQL Server ojbects (tables, store procedeures, triggers, views etc.) that might be available somewhere on the WEB. I was also wondering if most DBA`s prefix the object names like "sp_" or suffix the object like "Customer_T"? Any opinions?
View 1 Replies
View Related
