BCP To Csv (that Part Is Ok) WITH Dynamic File Headers And Footers (NOT Ok)
May 5, 2008
Hi All.
I am building an SSIS job that will export some data to a csv then ftp it to a remote site.
I have been able to create the csv alright, but I need to add header and footer lines to the csv.
The header must be:
Filename+ crlf (will not change)
File type+ crlf (will not change)
Create date+ crlf (obviously changes) -- format is mmddyyyy as text
And the footer is:
Filename+ crlf (will not change)
File type+ crlf (will not change)
Create date+ crlf (obviously changes) -- format is mmddyyyy as text
Total rows+ crlf (obviously changes)
So I need to first open the file, count the number of rows, then add the header and footer lines.
I would like to do this as a step in ssis, as a function (not by calling a compiled assembly or anything like that). I have no experience with vb.net, and haven't been able to find any snippets on the web that seem to work. Can anybody lend a hand? thx. David
View 3 Replies
ADVERTISEMENT
Jun 19, 2008
Hi all,
I am sure this is an easy question but I cant work it out.
I need to output the results of a table to file. I have set up a job to do this, as it needs to be updated every night.
I just do a select * from table
Howerver I dont want the coloum names at the top or the -------'s or the (1) rows bla bla
Bit.
Any ideas?
Dave
Dave Dunckley says there is a law for the rich and a law for the poor and a law for
Dirty Davey.
View 8 Replies
View Related
Apr 5, 2007
I see the Page Header and Page footer, but what about Report Header and Report Footers??? Doesn't look like ssrs has this ability, am I wrong??
View 6 Replies
View Related
Jun 12, 2007
I used ReportItems!textbox4.Value for displaying a data field in the header and footer.
But it is not getting repeated in the subsequent pages...
It is getting displayed only in the first page...
Kindly provide me with a solution to get it repeated in all the pages asap!!!........
Regards,
Aravind RJ
View 3 Replies
View Related
Apr 7, 2008
I have an image stored in a dataset that I would like to place in the page header and footer. Unfortunately dataset fields can not be placed in headers/footers.
Embedded pics in the project and/or report are NOT an option as the report must pull the image from the database. UNLESS there is a way to embed it FROM the dataset.
Normally I use =ReportItems!FieldName, but this doesn't seem to work when dealing with images.
I put the image in the header row the table holding the report information, but there are some pitfalls. Consider the following: put the Image in the top left cell of the header rows (A1) , put my Report Title in Cell (A2) and finally put =Now() in cell (B2).
When the report renders Cell (A1) has grown to accomodate the size of the image, Cell (A2) is fine, but cell (A3 - the date-) is pushed down...as expected (boooo!)
I used the following function =Fields!ReportTitle.Value & chr(10) & chr(13) & Fields!ReportDate.Value in (A2) a slick solution, but the padding is different and I need different font sizes and weights. (...almost)
I moved the image in (a1) and the rest of the fields following respecfully (B1, C1, D1...) but with parameters the header is now practically half the page (...ok so that was a bit of an stretch)
I tried the RepeatsWith property and couldn't get it to work???? Am I using it correctly? I have a table in the body of a report (table1). Above it, I place the image. In the image properties, I choose RepeatWith and select table1, I expect to see the image repeat on each page, but that is not the case. I'm probably missing a simple explanation.
I even tried to pass the image as a parameter. URRRNT! At least with my experience.
Have I exhausted all possibilities without extensive code?
All I'm trying to do is line up the Image with the report Title/date/parameter values in the HEADER making the report look pretty.
Thanks for the help...
SSRS 2005 User
View 1 Replies
View Related
Jan 21, 2008
Hello All,
I have designed some reports and kept these reports in the report server.
My question is: I want to change report header and footer values dynamically and save the new values in the report template, when the user enters new velues in ASP.NET GUI.
Next time if the user opens the same file the report should display the recent values.
Please help me in passing the parameters from ASP.NET app to SQL Reports and saving the parameters in the report template.
Thanks,
Rao.
View 6 Replies
View Related
Nov 11, 2006
Hello all,
I am creating a report in SSRS and the data is obtained through a stored procedure. One of the parameters is Begin_Date. This is simply a date field. I need to have it on the Page Header section. However, when I placed it there and ran the report, I received the following error -
Error2[rsFieldInPageSectionExpression] The Value expression for the textbox begindate refers to a field. Fields cannot be used in page headers or footers.
Is there a way around? I have never faced such a problem when I created reports in Crystal or ActiveReports. Please let me know whether I am missing anything.
Thanks in advance,
Saurav
View 2 Replies
View Related
May 2, 2008
I have a report that has three levels of grouping including headers (containing titles) and footers (containing summary values). I would like to programatically show/hide these header/footer sections based on a Show/Hide paramter. Is that possible? Currently I work around the problem by just having two physical reports (one with the header/footers, one without)
View 6 Replies
View Related
May 4, 2015
How to display the subreport Headers/footers in Main report (in SSRS SQL server 2008 r2)?
View 4 Replies
View Related
Nov 7, 2007
While exporting a SSRS 2005 report in CSV format ,can we include the report headers and footers also to be exported .
Thanks .
View 1 Replies
View Related
Dec 28, 2007
what is considered the best practice for placing headings above dynamic row headers if you want them to float with the row headers when scrolling horizontally?
View 8 Replies
View Related
Sep 22, 2013
I have a report which runs for last 12 months data. Since this is going to be last 12 months the column headers change every month. How can we implement this with dynamic column headers in the dataset?
View 9 Replies
View Related
Mar 2, 2014
I am trying to create an ssis package with dynamic csv file as output. and out format contains query output.
sample file name:
Unique identifier + query output + systemdate();
The expression is looking like this.
@[User::FilePath] + @[User::FileName] + ".CSV"
-- user filepath is a variable from ssis package. File name is the output from SQL query. using script task i have assigned the values to @[User::FileName] .
When I debugged the script task the value getting properly but same variable am using for Flafile destination. but its not working.
View 3 Replies
View Related
Mar 12, 2008
I have 2 tables (table1KKK, table2KKK), and want to run the same query on them by using parameter with the value "1" or "2".
Is it possible to use that parameter as a part of the queried table name?
Something like (only for demonstration doesnt work):
Select *
From table +myParameter + kkk
Thanks in advance!
View 3 Replies
View Related
Oct 3, 2006
I apparently have corrupted my file header on my database, and then copied it to my backup database.
Is there some way
1. to have the machine recreate the file header automatically? and fix it so that I can use the database
or
2. a back door into the database so that I can get the text files of my database to reconstruct the database from scratch.
The error mesage I receive is:
Database schema could not be retrieved for this connection. Please make sure the connection settings are correct and that the datase is online.
the header for fil c:inetpubwwwrootappapfinalAPP_DataASPNETDB.MDF is not a valide database header. The File Size property is incorrect.
Thank you
View 5 Replies
View Related
Dec 2, 2006
I'm writing to a flat file destination (CSV file) which contains 2 header rows, lets call it Col1 and Col2.
For some reason, the header rows seem to get duplicated in the output - i.e.
Col1,Col2
A,B
Col1,Col2
C,D
Is there any way to resolve this?
I don't want the file to be overwritten everytime since its used for record-keeping purposes.
Thanks
View 4 Replies
View Related
May 11, 2015
I want to add some name of the column's header from stored procedure to the CSV file
bcp "EXEC [databasname].[storedprocedure]" queryout C:estbcp_outputTable.csv -c -T -SPC01 -r
I'm using the code above in CMD.
Unfortunately, I cannot change the code that is inside of the stored procedure because it is already used in productionphase.
View 5 Replies
View Related
May 14, 2015
I'm copying files to a folder with the naming convention as follows in the source folder:
CM_ABC_MY_TEST.txt
In the destination folder, this filename needs to appear as:
CM_XYZ_MY_TEST.txt
In my File System Task, I'm pretty sure I'm going to need an expression with a replace, substring, etc. But am having a hard time nailing down the exact syntax.
View 10 Replies
View Related
Nov 21, 2006
Help,
I have a client that requres me to add a header line and trailer line to a flat file. The trick is the header and footer row is required to have a length of 120 with 5 colunmns while the data included in the query has a length of 1125 and about 70 columns. How can I append a header row to a file through SSIS.
View 1 Replies
View Related
Apr 18, 2015
Would it be possible to handle multiple file systems (e.g. xlsx, csv, mdb) with different /similar headers in single package without Script Component?
View 1 Replies
View Related
Aug 20, 2015
I have a table which has few columns as Numeric value. I need to export the output into a csv file as a report with column headers. I have used bcp command. Here column name and Column Header name is the same. The BCP query which i have used is Below
bcp "SelectCompanyCode,MonthId,ActualityCode,CompanyCounterpartCode,LocalProductCode,LocalCustomerBillTo,
DestinationCountryCode,LocalCostCenterCode,LocalGLAccountCode,LocalProjectCode,TXCurrencyCode,
TXAmountYTD,LocalCurrencyCode,LocalAmountYTD,SourceSystemFromTable(nolock)" queryout D: est.csv -c -t ";" -r -S -T
Is there any way to export bcp with header or any other command to generate the csv file.
View 1 Replies
View Related
Feb 8, 2007
Hi, this is probably a simple question but I just can't figure it out. I'm using SQL Server Reporting Services 2005 sp1.
I'm trying to design a report that displays a particular embedded image on the first page, and then a different one on every subsequent page. I.e full, fancy company logo on the first page, and a trimmed down version on every other. In Crystal, I would have simply used the Report Header and Page Header sections to achieve this - easy.
However, in SQL Reporting Services, there is only a Page Header section - therefore whatever I place in the Page Header shows on every page. Now, I know how to stop it displaying on the first page, but I don't know how to display the other image instead.
I read in a support forum that it is possible to do this by "placing report items above or below your data regions" but I can't get it to work.
Grateful for any assistance.
Matt
View 5 Replies
View Related
Oct 16, 2015
I have a filename as follows:
123_20151016_3152_AIRHtest1.txt
What I would like to extract from this fill name is the "3152" only. What is the correct way to do this?
View 3 Replies
View Related
Oct 5, 2006
My query relates to that of Lightbug3 and the solution from X002548.
My query is how do I have multiple headers within the export file?
I am extracting order information using DTS whereby there is a header containing the purchase order number and the detail being the product ordered for that PONumber.
I need to start a new header for each new purchase order number.
I'm looking to create something similar to
PONumber 1
Product, qty
Product qty
PONumber 2
Product, qty
Product qty
Would be grateful for any advice.
Thanks
View 2 Replies
View Related
Feb 9, 2015
SQL 2012 Ent SP2
Database is in simple recovery mode, and published with transaction replication push subscription, just one subscriber but the database is huge. I don't want to overwrite the schema at the subscriber either.
I had to run an alter database command on a published database, it created so many logs that an extra drive had to be added along with an extra log file to accommodate all the logs.
The problem I have is I'd like to know clear the file of logs so I can drop the temporary log file, and give the drive back, but I cannot.
I have tried dbcc shrinkfile with the emptyfile option but it never clears, I have also tried it with notruncate and truncateonly options (mainly out of desperation).
I do not need to worry about point in time restore as a full backup is taken before and after the operation. After which the database will be put back into Full recovery mode.
I have looked at log_reuse_wait_desc and the file says 'Replication', so I am now thinking the file cannot empty because replication is keeping one of the VLFs active. I tried dropping and recreating the subscription hoping it might free something up and I could get somewhere, but it made no difference.
Do I have to remove replication completely to get round this? Surely not.
I have also tried putting the database back into full recovery mode, doing a full DB backup, and a transaction log backup, but its made no difference, which is also what makes me think a portion of the log is still active because of replication, and perhaps the transactions have not gone through to the subscriber, which raises another question, why not?
I have not tried restarting SQL server, as I'd like to know a way out of this without having to do that, plus I do not think it would make any difference anyway.
View 1 Replies
View Related
Jul 24, 2015
Need to know how I can get the dynamic filename created in the FlatFile destination for insert into a package audit table?
Scenario: Have created a package that successfully outputs Dynamiclly named flat files { Format: C:Test’Comms_File_’ + ‘User::FileNumber’+’_’+Date +’.txt’
E.g.: Comms_File_1_20150724.txt, Comms_File_2_20150724.txt etc} using Foreach Loop Container :
* Enumerator Set to: “Foreach ADO Enumerator” with the ADO object source variable selected to identify how many total loop iterations there are i.e. Let’s say 4 thus 4 files to be created
*Variable Mappings : added the User::FileNumber – indicates which file number current loop iteration is i.e. 1,2,3,4
For the DataFlow task have a OLDBSource and a FlatFile Destination where Flat File ConnectionString is set up as:
@[User::Output_Path] + "Comms_File"+ @[User:: FileNumber] +"_" + replace((DT_WSTR, 10) (DT_DBDATE) GETDATE(),"-","")+ ".txt"
All this successfully creates these 4 files:
Comms_File_1_20150724.txt, Comms_File_2_20150724.txt, Comms_File_3_20150724.txt, Comms_File_4_20150724.txt
Now the QUESTION is how do I get these filenames as I need to insert them into a DB Audittable. The audit table looks like this:
CREATE TABLE dbo.MMMAudit
(
AuditID INT IDENTITY(1, 1) NOT NULL,
PackageName VARCHAR(100) NULL,
FileName VARCHAR(100) NULL,
LoadTime DATETIME NULL,
NumberofRecords INT NULL
)
To save the Filename & how many records in each file in our Audit Table, am using an Execute SQL Task and configuring it as this:
Execute SQL Task
Parameter mapping - Mapped the User Variable (RecordsInserted) and System Variable( PackageName) to Insert statement as shown below
SQLStatement: INSERT INTO [dbo].[MMMAudit] (
PackageName,NumerofRecords,LoadTime)
(?,?.GETDATE)
Again this all works terrific & populates the dbo.MMMAudit table as shown below BUT I also need to insert the respsctive file name – How do I do that?
AuditID PackageName FileName NumberOfRecords
1 MMM NULL 12
2 MMM NULL 23
3 MMM NULL 14
4 MMM NULL 1
View 2 Replies
View Related
Oct 9, 2006
I am having an issue with the File System Task.
I was wondering if there is a way to 'Move File' with the File System Task inside of a For Each Loop container but to dynamically set the Destination path variable.
Currently, this is what I have:
FileDestinationPath variable - set to C:TestFiles
FileSourcePath variable - set to C:TestFiles
FileNameAndLocation variable - set to blank
For Each Loop Container Iterates through a folder C:TestFiles that has .txt files in it with dates in the file name. Ex: Test_09142006.txt. Sets the file path (fully qualified) to the Variable Mapping FileNameAndLocation.
Script Task (within For Each Loop, first step) Sets the FileDestinationPath to the correct dated folder within C:TestFiles. For example, if the text files I want to move are for the 14th of September, it takes FileDestinationPath and appends the date folder to the end of it. The text files have a date in the file name (test_09142006.txt) and I am picking this apart (from FileNameAndLocation in the For Each Loop) to get the folder date. (dts.Variables(User::FileDestinationPath?).Value = dts.Variables(User::FileDestinationPath?).Value & ? Month & _? & Day & _? & Year & ?) which gives me C:TestFiles 9_14_2006?.
File System Task (within For Each Loop, second step) This is where the action is supposed to occur. I want it to take the FileDestinationPath and move the FileNameAndLocation file (from the For Loop) into this folder for each run.
Now as for my problem. I want this package to run everyday but it has to set the FileDestinationPath variable dynamically according to that days date. Basically, how do I get this to work since I cant hard code the destination path variable from the start? I have the DestinationVariable on the File System Task set to the FileDestinationPath variable, after the script task builds it. However, using FileNameAndLocation as the SourceVariable on my File System Task tells me that the Variable FileNameAndLocation? is used as a source or destination and is empty.?
Let me know if I need to clarify further...I may be missing something very simple. Any help would be greatly appreciated!
View 10 Replies
View Related
Oct 29, 2007
I have SSRS 2005 SP2 configured to work in Sharepoint integration. Everything works fine except that I am not able to programmatically change any property of report viewer web part (instance) that I have added on on home page of my sharepoint site.
I can do same thing via sharepoint UI but not through program. When my programs runs it fetches all web parts been added on home page, then I need to iterate through each one and find report viewer web part.
While iterating, as soon as I arrive to report viewer web part it is named as "Error web part" with error message as
"Windows SharePoint Services cannot deserialize the Web Part. Check the format of the properties and try again"
If someone has a solution, please respond at your earlist.
Thanks
Shankar
View 1 Replies
View Related
Dec 7, 2007
I have a table with a column named measurement decimal(18,1). If the value is 2.0, I want the stored proc to return 2 but if the value is 2.5 I want the stored proc to return 2.5. So if the value after the decimal point is 0, I only want the stored proc to return the integer portion. Is there a sql function that I can use to determine what the fraction part of the decimal value is? In c#, I can use
dr["measurement "].ToString().Split(".".ToCharArray())[1] to see what the value after the decimal is.
View 3 Replies
View Related
Feb 27, 2008
Hi All,
I have a source files folder where the files generated everyday.
My goal is pick the latest file and copy this single file to another folder.
I used the Foreach loop container and got the latest file and stored the file name to a varible i.e. LatestFile
Then i want to use the File System Task to copy this to the destination.
On the beginning, I could not setup the Latestfile since I don't its name then, so when I setup the Source Connection property of the File system task, it is not allowed to leave the SourceVarible as blank!
Any suggestion?
Thanks
Micor
View 3 Replies
View Related
Mar 28, 2006
Hi,
we have one requirement to run the package daily basis.
The package should run at specific time on that day.
we are using windows schedular for that.
we will have one new flatfile everyday.
Is there any process to attach this file to flat file source dynamically?
The requirement is,
The flat file should be able to read the new flatfile everyday.
we have no option change it manually, the flatfile source should have to take the file automatically at that time.
So that it can take that flatfile and load it into database table.
View 1 Replies
View Related
Jan 28, 2015
I have made the following Scalar-valued function:
CREATE FUNCTION [dbo].[TimeCalc]
(
@OriginalTime AS INTEGER
, @TenthsOrHundredths AS INTEGER -- code 2: 1/10, code 4: 1/100
)
RETURNS NVARCHAR(8)
[Code] ....
What it does is convert numbers to times
E.g.: 81230 gets divided by 10 (times in seconds: 8123). This 1 1 full minute, and the remainder = 2123 making it 1.21.23 mins)
So far so good (function works perfectly)
My question: sometimes times are in 1/100 (like above sample), sometimes in 1/10.
This means that, e.g. with a time like 3.23.40 the last zero must be deleted.
My thoughts are to use the results from the Return Case part, and as the code = 4: leave it as it is,
is the code 2 the use LEFT(... result Return Case ..., Len(..result Return Case.. - 1))
There are 5 codes: 0 1 2 3 and 4
View 9 Replies
View Related
Sep 18, 2006
I am having a big issue trying to resolve this problem. Hope to layout it out well enough to understand.
I have a dataset like this.
Name Sales$ Quota Month
-----------------------------------------------
John Doe 10 10 1/1/2006
John Doe 20 10 1/1/2006
John Doe 15 10 1/1/2006
John Doe 18 10 1/1/2006
-----------------------------------------------
Jane Doe 12 5 1/1/2006
Jane Doe 6 5 1/1/2006
-----------------------------------------------
Jack Black 18 15 1/1/2006
Jack Black 22 15 1/1/2006
Jack Black 14 15 1/1/2006
-----------------------------------------------
The issue I am having is quota is truely only the one value, not a sum of the quota. So John Doe should have a quota of 10, not 40. In the report layout, I simply do a max or first to get the names quota. The issue is doing a grand total in a table footer. When you do a sum, you of course get a sum of each value, not a sum of the distinct values for each name (which is the grouping of the report).
If you add all the total quota up we get 95. If I take a count of quota you get 9. Divide 95 by 9 you do not get the correct quota total. I need to get a total of 30 for quota. If I take a count of each name, and divide the total quota for that group by the count...I get the correct number.
Example: John Doe would total to 40 for quota...divide by 4 you get 10...which is correct
I would then need to total all these grouping totals up for a grand total in a Table footer (not a group footer, but a table footer).
I have tried runningvalue to no avail. Tried using reportitems! but cannot do a sum in a report footer for reportitems!.
Any thoughts? I was hoping I could use reportitems! to reference the cell name, but as I have seen in many posts this is not possible in a table footer.
Any help or push in the right direction would be wonderful. If this needs further clarification, please let me know.
95
95
View 11 Replies
View Related
