BCP To Csv (that Part Is Ok) WITH Dynamic File Headers And Footers (NOT Ok)
May 5, 2008
Hi All.
I am building an SSIS job that will export some data to a csv then ftp it to a remote site.
I have been able to create the csv alright, but I need to add header and footer lines to the csv.
The header must be:
Filename+ crlf (will not change)
File type+ crlf (will not change)
Create date+ crlf (obviously changes) -- format is mmddyyyy as text
And the footer is:
Filename+ crlf (will not change)
File type+ crlf (will not change)
Create date+ crlf (obviously changes) -- format is mmddyyyy as text
Total rows+ crlf (obviously changes)
So I need to first open the file, count the number of rows, then add the header and footer lines.
I would like to do this as a step in ssis, as a function (not by calling a compiled assembly or anything like that). I have no experience with vb.net, and haven't been able to find any snippets on the web that seem to work. Can anybody lend a hand? thx. David
I have an image stored in a dataset that I would like to place in the page header and footer. Unfortunately dataset fields can not be placed in headers/footers.
Embedded pics in the project and/or report are NOT an option as the report must pull the image from the database. UNLESS there is a way to embed it FROM the dataset.
Normally I use =ReportItems!FieldName, but this doesn't seem to work when dealing with images.
I put the image in the header row the table holding the report information, but there are some pitfalls. Consider the following: put the Image in the top left cell of the header rows (A1) , put my Report Title in Cell (A2) and finally put =Now() in cell (B2).
When the report renders Cell (A1) has grown to accomodate the size of the image, Cell (A2) is fine, but cell (A3 - the date-) is pushed down...as expected (boooo!)
I used the following function =Fields!ReportTitle.Value & chr(10) & chr(13) & Fields!ReportDate.Value in (A2) a slick solution, but the padding is different and I need different font sizes and weights. (...almost)
I moved the image in (a1) and the rest of the fields following respecfully (B1, C1, D1...) but with parameters the header is now practically half the page (...ok so that was a bit of an stretch)
I tried the RepeatsWith property and couldn't get it to work???? Am I using it correctly? I have a table in the body of a report (table1). Above it, I place the image. In the image properties, I choose RepeatWith and select table1, I expect to see the image repeat on each page, but that is not the case. I'm probably missing a simple explanation.
I even tried to pass the image as a parameter. URRRNT! At least with my experience.
Have I exhausted all possibilities without extensive code?
All I'm trying to do is line up the Image with the report Title/date/parameter values in the HEADER making the report look pretty.
I have designed some reports and kept these reports in the report server.
My question is: I want to change report header and footer values dynamically and save the new values in the report template, when the user enters new velues in ASP.NET GUI.
Next time if the user opens the same file the report should display the recent values.
Please help me in passing the parameters from ASP.NET app to SQL Reports and saving the parameters in the report template.
I am creating a report in SSRS and the data is obtained through a stored procedure. One of the parameters is Begin_Date. This is simply a date field. I need to have it on the Page Header section. However, when I placed it there and ran the report, I received the following error -
Error2[rsFieldInPageSectionExpression] The Value expression for the textbox �begindate� refers to a field. Fields cannot be used in page headers or footers.
Is there a way around? I have never faced such a problem when I created reports in Crystal or ActiveReports. Please let me know whether I am missing anything.
I have a report that has three levels of grouping including headers (containing titles) and footers (containing summary values). I would like to programatically show/hide these header/footer sections based on a Show/Hide paramter. Is that possible? Currently I work around the problem by just having two physical reports (one with the header/footers, one without)
what is considered the best practice for placing headings above dynamic row headers if you want them to float with the row headers when scrolling horizontally?
I have a report which runs for last 12 months data. Since this is going to be last 12 months the column headers change every month. How can we implement this with dynamic column headers in the dataset?
I am trying to create an ssis package with dynamic csv file as output. and out format contains query output.
sample file name:
Unique identifier + query output + systemdate();
The expression is looking like this.
@[User::FilePath] + @[User::FileName] + ".CSV"
-- user filepath is a variable from ssis package. File name is the output from SQL query. using script task i have assigned the values to @[User::FileName] .
When I debugged the script task the value getting properly but same variable am using for Flafile destination. but its not working.
I have 2 tables (table1KKK, table2KKK), and want to run the same query on them by using parameter with the value "1" or "2". Is it possible to use that parameter as a part of the queried table name? Something like (only for demonstration �� doesn��t work): Select * From table +myParameter + kkk Thanks in advance!
I'm copying files to a folder with the naming convention as follows in the source folder:
CM_ABC_MY_TEST.txt
In the destination folder, this filename needs to appear as:
CM_XYZ_MY_TEST.txt
In my File System Task, I'm pretty sure I'm going to need an expression with a replace, substring, etc. But am having a hard time nailing down the exact syntax.
I have a client that requres me to add a header line and trailer line to a flat file. The trick is the header and footer row is required to have a length of 120 with 5 colunmns while the data included in the query has a length of 1125 and about 70 columns. How can I append a header row to a file through SSIS.
I have a table which has few columns as Numeric value. I need to export the output into a csv file as a report with column headers. I have used bcp command. Here column name and Column Header name is the same. The BCP query which i have used is Below
Hi, this is probably a simple question but I just can't figure it out. I'm using SQL Server Reporting Services 2005 sp1.
I'm trying to design a report that displays a particular embedded image on the first page, and then a different one on every subsequent page. I.e full, fancy company logo on the first page, and a trimmed down version on every other. In Crystal, I would have simply used the Report Header and Page Header sections to achieve this - easy.
However, in SQL Reporting Services, there is only a Page Header section - therefore whatever I place in the Page Header shows on every page. Now, I know how to stop it displaying on the first page, but I don't know how to display the other image instead.
I read in a support forum that it is possible to do this by "placing report items above or below your data regions" but I can't get it to work.
My query relates to that of Lightbug3 and the solution from X002548.
My query is how do I have multiple headers within the export file?
I am extracting order information using DTS whereby there is a header containing the purchase order number and the detail being the product ordered for that PONumber.
I need to start a new header for each new purchase order number.
Database is in simple recovery mode, and published with transaction replication push subscription, just one subscriber but the database is huge. I don't want to overwrite the schema at the subscriber either.
I had to run an alter database command on a published database, it created so many logs that an extra drive had to be added along with an extra log file to accommodate all the logs.
The problem I have is I'd like to know clear the file of logs so I can drop the temporary log file, and give the drive back, but I cannot.
I have tried dbcc shrinkfile with the emptyfile option but it never clears, I have also tried it with notruncate and truncateonly options (mainly out of desperation).
I do not need to worry about point in time restore as a full backup is taken before and after the operation. After which the database will be put back into Full recovery mode.
I have looked at log_reuse_wait_desc and the file says 'Replication', so I am now thinking the file cannot empty because replication is keeping one of the VLFs active. I tried dropping and recreating the subscription hoping it might free something up and I could get somewhere, but it made no difference.
Do I have to remove replication completely to get round this? Surely not.
I have also tried putting the database back into full recovery mode, doing a full DB backup, and a transaction log backup, but its made no difference, which is also what makes me think a portion of the log is still active because of replication, and perhaps the transactions have not gone through to the subscriber, which raises another question, why not?
I have not tried restarting SQL server, as I'd like to know a way out of this without having to do that, plus I do not think it would make any difference anyway.
Need to know how I can get the dynamic filename created in the FlatFile destination for insert into a package audit table?
Scenario: Have created a package that successfully outputs Dynamiclly named flat files { Format: C:Test’Comms_File_’ + ‘User::FileNumber’+’_’+Date +’.txt’
E.g.: Comms_File_1_20150724.txt, Comms_File_2_20150724.txt etc} using Foreach Loop Container :
* Enumerator Set to: “Foreach ADO Enumerator” with the ADO object source variable selected to identify how many total loop iterations there are i.e. Let’s say 4 thus 4 files to be created
*Variable Mappings : added the User::FileNumber – indicates which file number current loop iteration is i.e. 1,2,3,4
For the DataFlow task have a OLDBSource and a FlatFile Destination where Flat File ConnectionString is set up as:
I was wondering if there is a way to 'Move File' with the File System Task inside of a For Each Loop container but to dynamically set the Destination path variable.
Currently, this is what I have: FileDestinationPath variable - set to C:TestFiles FileSourcePath variable - set to C:TestFiles FileNameAndLocation variable - set to blank
For Each Loop Container �� Iterates through a folder C:TestFiles that has .txt files in it with dates in the file name. Ex: Test_09142006.txt. Sets the file path (fully qualified) to the Variable Mapping FileNameAndLocation.
Script Task (within For Each Loop, first step) �� Sets the FileDestinationPath to the correct dated folder within C:TestFiles. For example, if the text files I want to move are for the 14th of September, it takes FileDestinationPath and appends the date folder to the end of it. The text files have a date in the file name (test_09142006.txt) and I am picking this apart (from FileNameAndLocation in the For Each Loop) to get the folder date. (dts.Variables(��User::FileDestinationPath�?).Value = dts.Variables(��User::FileDestinationPath�?).Value & ���? Month & ��_�? & Day & ��_�? & Year & ���?) which gives me ��C:TestFiles9_14_2006�?.
File System Task (within For Each Loop, second step) �� This is where the action is supposed to occur. I want it to take the FileDestinationPath and move the FileNameAndLocation file (from the For Loop) into this folder for each run.
Now as for my problem. I want this package to run everyday but it has to set the FileDestinationPath variable dynamically according to that day��s date. Basically, how do I get this to work since I can��t hard code the destination path variable from the start? I have the DestinationVariable on the File System Task set to the FileDestinationPath variable, after the script task builds it. However, using FileNameAndLocation as the SourceVariable on my File System Task tells me that the ��Variable ��FileNameAndLocation�? is used as a source or destination and is empty.�?
Let me know if I need to clarify further��...I may be missing something very simple. Any help would be greatly appreciated!
I have SSRS 2005 SP2 configured to work in Sharepoint integration. Everything works fine except that I am not able to programmatically change any property of report viewer web part (instance) that I have added on on home page of my sharepoint site. I can do same thing via sharepoint UI but not through program. When my programs runs it fetches all web parts been added on home page, then I need to iterate through each one and find report viewer web part. While iterating, as soon as I arrive to report viewer web part it is named as "Error web part" with error message as "Windows SharePoint Services cannot deserialize the Web Part. Check the format of the properties and try again"
If someone has a solution, please respond at your earlist.
I have a table with a column named measurement decimal(18,1). If the value is 2.0, I want the stored proc to return 2 but if the value is 2.5 I want the stored proc to return 2.5. So if the value after the decimal point is 0, I only want the stored proc to return the integer portion. Is there a sql function that I can use to determine what the fraction part of the decimal value is? In c#, I can use dr["measurement "].ToString().Split(".".ToCharArray())[1] to see what the value after the decimal is.
I have a source files folder where the files generated everyday. My goal is pick the latest file and copy this single file to another folder. I used the Foreach loop container and got the latest file and stored the file name to a varible i.e. LatestFile Then i want to use the File System Task to copy this to the destination. On the beginning, I could not setup the Latestfile since I don't its name then, so when I setup the Source Connection property of the File system task, it is not allowed to leave the SourceVarible as blank!
I am having a big issue trying to resolve this problem. Hope to layout it out well enough to understand.
I have a dataset like this.
Name Sales$ Quota Month ----------------------------------------------- John Doe 10 10 1/1/2006 John Doe 20 10 1/1/2006 John Doe 15 10 1/1/2006 John Doe 18 10 1/1/2006 ----------------------------------------------- Jane Doe 12 5 1/1/2006 Jane Doe 6 5 1/1/2006 ----------------------------------------------- Jack Black 18 15 1/1/2006 Jack Black 22 15 1/1/2006 Jack Black 14 15 1/1/2006 -----------------------------------------------
The issue I am having is quota is truely only the one value, not a sum of the quota. So John Doe should have a quota of 10, not 40. In the report layout, I simply do a max or first to get the names quota. The issue is doing a grand total in a table footer. When you do a sum, you of course get a sum of each value, not a sum of the distinct values for each name (which is the grouping of the report).
If you add all the total quota up we get 95. If I take a count of quota you get 9. Divide 95 by 9 you do not get the correct quota total. I need to get a total of 30 for quota. If I take a count of each name, and divide the total quota for that group by the count...I get the correct number.
Example: John Doe would total to 40 for quota...divide by 4 you get 10...which is correct
I would then need to total all these grouping totals up for a grand total in a Table footer (not a group footer, but a table footer).
I have tried runningvalue to no avail. Tried using reportitems! but cannot do a sum in a report footer for reportitems!.
Any thoughts? I was hoping I could use reportitems! to reference the cell name, but as I have seen in many posts this is not possible in a table footer.
Any help or push in the right direction would be wonderful. If this needs further clarification, please let me know.
