3.3.2 - Download Remote Files

Action Option -DR (-DownloadRemote) (Alias: -DownloadRemoteFile) :

(Alias: -DownloadRemoteFile) downloads or copies server files to local working disk, or generates new data files via local processing. The resulting files are called remote files; they are later validated and converted to local files by -BL (-BuildLocal).

dsupdt [[-(DS|Dataset)] dNNNNNN] -(DR|DownloadRemote) [Mode Options]
[-(CI|ControlIndex) UpdateControlIndex]
[-(LI|LocalIndex) LocalFileIndices]
[-(LF|LocalFile) LocalFileNames]
[-(RF|RemoteFile) RemoteFileNames]
[-(SF|ServerFile) ServerFileNames]
[-(DO|DownloadOrder) DownloadOrderIndices]
[-(XO|ExecOrder) ExecOrderIndex]
[-(DC|DownloadCommand) DownloadCommand]
[-(PR|ProcessRemote) AdditionalRemoteFileProcess]
[-(ED|EndDate) NextDataEndDate]
[-(EH|EndHour) NextDataEndHour]
[-(GP|GenericPattern) GenericPatterns]
[-(WD|WorkDir) WorkingDirectory]
[-(MR|MissRemote) AllowMissRemoteFile]
[-(FQ|Frequency) UpdateFrequency]
[-(CD|CurrentDate) CurrentDate]
[-(CH|CurrentHour) CurrentHour]
[-(VS|ValidSize) MinSizeForValidFile]
[-(PL|ProcessLimit) MaxNumberOfChildProcesses]
[-(HO|HourOffset) TimeZoneHourOffset]
[-(QS|QsubOptions) PBSBatchOptions]
[-(BP|BatchProcess) [BatchProcessHosts]]
[-(CC|CarbonCopy) Cc’dEmailAddresses]
[-(DB|Debug) DebugModeInfo]

Available Mode options:

-(AW|AnyWhere)

works with -BP (-BatchProcess) to allow the recorded dsupdt command to start from any directory

-(BG|BackGround)

runs in the background; suppresses screen output and errors

-(CN|CheckNewer)

when the server file is available locally, checks whether it has changed on the server and re-downloads if so

-(CP|CurrentPeriod)

allows the end date/hour to be processed beyond the current date/hour if it falls within the current update period

-(EE|ErrorEmail)

sends email only when an error occurs during retrieval of remote files

-(FU|ForceUpdate)

forces a download for at least one end date/time, even if the update is not yet due

-(GZ|GMTZone)

uses GMT dates/times as controlling times

-(HU|HourlyUpdate)

advances time tracking to hours after a successful remote file download

-(IE|IgnoreError)

works with -MU (-MultipleUpdate) to skip download errors and continue with remaining remote files

-(KS|KeepServer)

keeps the server file on local disk by copying it to the remote file location instead of moving it

-(LO|LogOn)

enables detailed logging when option -PL is present

-(MO|MissedOnly)

downloads a remote file only if it has not been archived yet

-(MU|MultipleUpdate)

downloads across all available update periods; without this option, only one period is processed

-(NE|NoEmail)

suppresses post-download email notification

-(NY|NoLeapYear)

skips February 29 for leap years

-(QE|QuitError)

stops all downloads for the dataset on the first error, rather than skipping and continuing

-(RD|RetryDownload)

re-downloads the remote file even if it already exists locally

-(SE|SummaryEmail)

sends a summary-only email after the action, without detailed log information

-(UB|UseBeginTime)

uses the period’s beginning time instead of the end time when substituting temporal patterns

When a remote file already exists on local disk, the download action is skipped. To re-download, either remove the existing file manually or use Mode option -RD (-RetryDownload).

A server file is the original file on the remote server. Specify it only when its name differs from the remote file name.