Hi,
I have 6 loggers in monitoring equipment and sending data to a central FTP server every 15 minuets and every 24 hours.
The problem i have is that they all ftp their data correctly for several days, or sometimes weeks and then the data file appears empty after a certain time

An example of a good file is

Timestamp TZ V(S4)_TUM (1S) (V) I(S4)_TUM (1S) (mA)
19/12/2016 18:00 n 749.81 581.63
19/12/2016 18:00 n 750.04 581.74
19/12/2016 18:00 n 750.74 581.82
19/12/2016 18:00 n 750.51 581.61
19/12/2016 18:00 n 749.59 581.49
19/12/2016 18:00 n 748.66 581.59
19/12/2016 18:00 n 749.81 581.84
19/12/2016 18:00 n 750.28 581.7
19/12/2016 18:00 n 748.44 581.7
etc.. for 900 samples in a 15 min period..

what happens when the problem occurs is that only the header is transferred to the ftp file with no date or data contained in the ftp file. as shown below.

Timestamp TZ V(S4)_TUM (1S) (V) I(S4)_TUM (1S) (mA)

The file is empty of data but does contain the headers for the data.

The loggers continue to FTP this empty file as per the schedule set until i resave the configuration to the logger upon which time the files contain data again from the time of the re save configuration.
Attached is the configuration, I am not sure what is causing this..

PROFILE USER SITE="Tumon Bay"
PROFILE HOST_PORT BPS="57600"
PROFILE HOST_PORT DATA_BITS="8"
PROFILE HOST_PORT STOP_BITS="1"
PROFILE HOST_PORT PARITY="NONE"
PROFILE HOST_PORT FLOW="SOFTWARE"
PROFILE HOST_PORT FUNCTION="COMMAND"
PROFILE SERSEN_PORT BPS="1200"
PROFILE SERSEN_PORT DATA_BITS="8"
PROFILE SERSEN_PORT STOP_BITS="1"
PROFILE SERSEN_PORT PARITY="NONE"
PROFILE SERSEN_PORT FLOW="NONE"
PROFILE SERSEN_PORT MODE="RS232"
PROFILE SERSEN_PORT FUNCTION="SERIAL"
PROFILE USB_PORT FUNCTION="COMMAND"
PROFILE HOST_MODEM EXT_POWER_SWITCH="NONE"
PROFILE HOST_MODEM DETECTION="DSR"
PROFILE HOST_MODEM INIT="AT"
PROFILE HOST_MODEM MAX_CD_IDLE="43200"
PROFILE ETHERNET_SESSION SMTP_SERVER=""
PROFILE ETHERNET_SESSION SMTP_ACCOUNT=""
PROFILE ETHERNET_SESSION SMTP_PASSWORD=""
PROFILE ETHERNET_SESSION SMTP_PORT="25"
PROFILE ETHERNET_SESSION RETURN_ADDRESS="Your.Logger@datataker.com"
PROFILE ETHERNET_SESSION SENDER_NAME=""
PROFILE ETHERNET_SESSION RETRY_DELAY_S="30"
PROFILE ETHERNET ENABLE="YES"
PROFILE ETHERNET IP_ADDRESS="172.16.53.200"
PROFILE ETHERNET SUBNET_MASK="255.255.255.0"
PROFILE ETHERNET GATEWAY="172.16.53.1"
PROFILE PPP USER="DATATAKER"
PROFILE PPP PASSWORD="DATATAKER"
PROFILE FTP_SERVER PORT="21"
PROFILE FTP_SERVER USER="DATATAKER"
PROFILE FTP_SERVER PASSWORD="DATATAKER"
PROFILE FTP_SERVER ALLOW_ANONYMOUS="YES"
PROFILE NETWORK DNS_SERVER_1="0.0.0.0"
PROFILE NETWORK DNS_SERVER_2="0.0.0.0"
PROFILE COMMAND_SERVER PORT="7700"
PROFILE COMMAND_SERVER SESSION_TIMEOUT="0"
PROFILE MODBUS_SERVER TCPIP_PORT="502"
PROFILE MODBUS_SERVER SERSEN_ADDRESS="0"
PROFILE MODBUS_SERVER HOST_ADDRESS="0"
PROFILE MODBUS_SERVER USB_ADDRESS="0"
PROFILE NTP BACKGROUND_ENABLE="YES"
PROFILE NTP SERVER="172.16.52.1"
PROFILE NTP BACKGROUND_PERIOD="3599S"
PROFILE NTP MAX_SLEW_CORRECTION="3S"
PROFILE NTP MAX_JUMP_CORRECTION="24H"
PROFILE NTP MIN_CORRECTION="50T"
PROFILE NTP SLEW_RATE="10"
PROFILE NTP TIMEOUT="2S"
PROFILE NTP BACKGROUND_WAKEUP_DELAY="3S"
PROFILE LOCALE TIME_ZONE="0"
PROFILE STARTUP RUN="CURRENT_JOB"
PROFILE STARTUP MAINTAIN_OUTPUTS="NO"
PROFILE STARTUP MAINTAIN_VARS="NO"
PROFILE UNLOAD FTP_RETRIES="INFINITE"
PROFILE DISPLAY AUTOSCROLL_INTERVAL="2S"
PROFILE DISPLAY AUTOSCROLL_DELAY="30S"
PROFILE DISPLAY AUTOACK_DELAY="0S"
PROFILE STORAGE FORMAT="NORMAL"
PROFILE STORAGE UNLOAD_BUFFER_SIZE="16384"
PROFILE FUNCTION F1_LABEL=""
PROFILE FUNCTION F1_COMMAND=""
PROFILE FUNCTION F2_LABEL=""
PROFILE FUNCTION F2_COMMAND=""
PROFILE FUNCTION F3_LABEL=""
PROFILE FUNCTION F3_COMMAND=""
PROFILE FUNCTION F4_LABEL=""
PROFILE FUNCTION F4_COMMAND=""
PROFILE FUNCTION F5_LABEL=""
PROFILE FUNCTION F5_COMMAND=""
PROFILE FUNCTION F6_LABEL=""
PROFILE FUNCTION F6_COMMAND=""
PROFILE FUNCTION F7_LABEL=""
PROFILE FUNCTION F7_COMMAND=""
PROFILE FUNCTION F8_LABEL="Remove USB"
PROFILE FUNCTION F8_COMMAND="REMOVEMEDIA"
PROFILE FUNCTION F9_LABEL="Copy logged data"
PROFILE FUNCTION F9_COMMAND="COPYD dest=a: format=dbd archive=y src=BD"
PROFILE FUNCTION F10_LABEL="Auto Ethernet IP"
PROFILE FUNCTION F10_COMMAND="PROFILE ETHERNET ENABLE=YES; PROFILE ETHERNET IP_ADDRESS=0.0.0.0; PROFILE ETHERNET IP_ADDRESS=AUTO"
PROFILE SWITCHES C="ON"
PROFILE SWITCHES D="OFF"
PROFILE SWITCHES E="ON"
PROFILE SWITCHES F="OFF"
PROFILE SWITCHES H="OFF"
PROFILE SWITCHES I="OFF"
PROFILE SWITCHES K="ON"
PROFILE SWITCHES L="OFF"
PROFILE SWITCHES M="ON"
PROFILE SWITCHES N="ON"
PROFILE SWITCHES R="ON"
PROFILE SWITCHES S="ON"
PROFILE SWITCHES T="OFF"
PROFILE SWITCHES U="ON"
PROFILE SWITCHES W="OFF"
PROFILE SWITCHES X="OFF"
PROFILE SWITCHES Z="ON"
PROFILE PARAMETERS P0="20"
PROFILE PARAMETERS P3="1500"
PROFILE PARAMETERS P4="800"
PROFILE PARAMETERS P8="0"
PROFILE PARAMETERS P9="1"
PROFILE PARAMETERS P11="60"
PROFILE PARAMETERS P14="600"
PROFILE PARAMETERS P15="2"
PROFILE PARAMETERS P16="0"
PROFILE PARAMETERS P17="30"
PROFILE PARAMETERS P20="2"
PROFILE PARAMETERS P21="1"
PROFILE PARAMETERS P22="32"
PROFILE PARAMETERS P24="13"
PROFILE PARAMETERS P26="60"
PROFILE PARAMETERS P27="0"
PROFILE PARAMETERS P28="0"
PROFILE PARAMETERS P31="3"
PROFILE PARAMETERS P32="5"
PROFILE PARAMETERS P33="0"
PROFILE PARAMETERS P36="0"
PROFILE PARAMETERS P38="46"
PROFILE PARAMETERS P39="0"
PROFILE PARAMETERS P40="58"
PROFILE PARAMETERS P41="0"
PROFILE PARAMETERS P50="0"
PROFILE PARAMETERS P51="6"
PROFILE PARAMETERS P53="10"
PROFILE PARAMETERS P55="16383"
PROFILE PARAMETERS P56="0"
PROFILE PARAMETERS P62="0"

BEGIN"config"
' Generated by dEX Configuration Builder Version 1.72.007 (Firmware Version 9.18.6291)
' Target device: DT80-3
password=""

S1=0,0,0,100

RS10S
RA"1S" ("b:",ALARMS:OV:10MB:W60,DATA:OV:25H)1S
LOGONA
1V("V(S4)TUM (1S)~V",=1001CV,LM,NA,GL3V)
1*V("I(S4)TUM (1S)~mA",=1002CV,LM,NA,GL3V)
RD"60_S" ("b:",ALARMS:OV:100KB:W60,DATA:OV:32D)60S
LOGOND
1V("V(S4)TUM (60S)~V",=1007CV,LM,NA,GL3V)
1*V("I(S4)_TUM (60S)~mA",=1008CV,LM,NA,GL3V)
RF"15_MIN_FTP" ("b:",ALARMS:OV:100R:W60,DATA:OV:32D)15M
LOGOFFF

' User defined
22sv(=3CV) 3CV;
21sv(=2CV) 2CV;
20sv(=1CV) 1CV;

DO{copyd dest="ftp://admin: xxx@172.16.52.210:21/Web/tum3h.csv?priority=yes&interface=" format=CSV sched=A data=Y alarms=N start=-3}
DO{copyd dest="ftp://admin: xxx@172.16.52.210:21/Web/tum_24h_1s.csv?priority=yes&interface=" format=CSV sched=A data=Y alarms=N start=-1T}
DO{copyd dest="ftp://admin: xxx@172.16.52.210:21/Web/tum_24h.csv?priority=yes&interface=" format=CSV sched=D data=Y alarms=N start=-1T}
DO{copyd dest="ftp://admin: xxx@172.16.52.210:21/Web/tum_7d.csv?priority=yes&interface=" format=CSV sched=D data=Y alarms=N start=-7T}
DO{copyd dest="ftp://admin: xxx@172.16.52.210:21/Web/tum_31d.csv?priority=yes&interface=" format=CSV sched=D data=Y alarms=N start=-31T}
DO{copyd dest="ftp://admin: xxx@172.16.52.210:21/PFE_DATA/3_Tumon_Bay/SEGMENT_4_PFE_1/VOLT_CURRENT_DATA/15_MIN/%3F(3CV)/%3F(2CV)/%3F(1CV)/Tumon_Bay_PFE_1_15_MIN%3F(timestamp).csv?priority=yes&interface=" format=CSV sched=A data=Y alarms=N start=-0:15}
RI"24HOUR_FTP" ("b:",ALARMS:OV:100R:W60,DATA:OV:32D)24H
LOGOFFI
DO{copyd dest="ftp://admin: xxx@172.16.52.210:21/PFE_DATA/3_Tumon_Bay/SEGMENT_4_PFE_1/VOLT_CURRENT_DATA/24_HOUR/%3F(3CV)/%3F(2CV)/Tumon_Bay_PFE_1_24_HOUR%3F(timestamp).csv?priority=yes&interface=" format=CSV sched=D data=Y alarms=N start=-1T}
END

Further to the above, It seems some of the FTP attempts continue to work and others are locked up,
The Logs are as below.

EVENT ,2017/02/09,22:32:33,0.730590,"Reset 9.18.6291 EXCEPTION (c8610007)"
EVENT ,2017/02/09,22:32:34,0.252807,"Beginning entry of job "CONFIG""
EVENT ,2017/02/09,22:32:35,0.671997,"Loaded job "CONFIG""

2017/02/09,22:32:33
Exception 200 at 0x0008bc1c
SRR1=00009032 DSISR=00000d3c DAR=00000000 BAR=00000000 MSTAT=00000080
LR=0008bbb0 CR=42008028 CTR=00000000 XER=20000000
R00:07 0000003c 04188e38 00142da0 00000257 00000008 00000000 00000010 04188dfc
R08:15 03ff0000 0000003c 00128840 04184ec0 48000084 040612ac 53535353 53535353
R16:23 53535353 53535353 53535353 53535353 00000000 0000000a 0407155c 00000000
R24:31 041b8c80 00000256 00000000 041b8c81 00000000 040605cc 00000000 04188e38
Call stack: 0008bee0 0008c230 000839dc 0008338c 000825f8 0008192c 00079ad8 000ecb48
000ecadc ffffffff ffffffff ffffffff ffffffff ffffffff ffffffff ffffffff

The times listed are the times the last ftp attempt failed.

How many concurrent FTP sessions can the DT80 support?

Thanks
Paul

Seems that each logger must have a unique user set up for the FTP server, They can not all use the same account on the FTP server. Problems seem to arise when multiple loggers are connected to the FTP server with the same user name even though the IP addresses are different. Now the register for FTP in Logger is reporting 2 after each FTP transfer.

Still having problems with all 6 loggers with this.
Three days after a save and config, the logger stops FTP,ing the contents of the file and only the headers.
It seems there is an issue accessing the stored data sometimes, Please see the error log below..

Please help !

EVENT ,2017/02/16,04:15:52,0.744262,"Beginning entry of job "CONFIG""
EVENT ,2017/02/16,04:15:58,0.186767,"Loaded job "CONFIG""
EVENT ,2017/02/19,23:23:38,0.192871,"E118 - Error accessing drive B: Media failure"
EVENT ,2017/02/19,23:23:38,0.304809,"E110 - Error accessing storefile: 'B:\JOBS\CONFIG\A\DATA_A.DBD' (250/16777215)"
EVENT ,2017/02/19,23:23:38,0.397460,"FTP XFER: local file read/write error (-13)"
EVENT ,2017/02/19,23:23:38,0.786132,"E109 - File IO error: Error Code 14: 'B:\UNLOAD\oxf_24h.csv'"
EVENT ,2017/02/19,23:24:00,0.268676,"E110 - Error accessing storefile: 'B:\JOBS\CONFIG\D\DATA_D.DBD' (242/16777215)"

Hi Paul,

Could you inform me the size of each FTP transfer? The last one (start=-31T) becomes my concern.
What is the loading time for all FTP process? Is there any overlap between each trigger? (previous trigger has not finished but a new trigger already commenced).
Please also check the event log for any FTP transfer failure beside XFER error (-13).
-13 error itself indicates permission issue in the server which restrict some action.

If possible, please enable FTP diagnostic (P56=8 ) when sending FTP and getting that error.

Best regards,
Rudy Gunawan

Hi Rudy,

Thanks you for the reply, its pointing me in the correct direction hopefully.
The file sizes are listed below. these are the maximum file sizes as the data window grows to the specifies time.
I have enables P56=8 in all loggers and am seeing the correct FTP handshaking, Have yet to capture a failed attempt since setting the p56=8
The even log shows "FTP DATA DISCARDED (queue overflow):" I am trying to work out is this is the logger or my FTP server.

I have also deleted the 24h_1s data schedule as this is the largest file @4mB that gets transferred in a 15 min window.. All 6 of the loggers connect at the same to the FTP server ever 15 min, perhaps this is causing the over flow.. Not sure.
Is there a way to off set each schedule in each logger within the 15 min window? I need the 15 min window to display real( 15 min old) time data on a webpage running on the ftp server.

Thanks
PAul

xxx_24h_1s is aroung 4mB (2 READINGS X 86400 seconds 1 second sample)
xxx_3h.csv is around 500kB (2 READINGS X 10800 Seconds 1 second sample)
xxx_7d.csv IS around 500kB (2 READINGS X 10080 (10 Second sample time)
xxx_31d.csv IS aroung 12mB @ end of 31 days (2 READINGS X 267840 samples in a 31 day period 10 Second sample time)
xxx_24h.csv is around 400KB ( 2 READINGS X 8640 samples 10Second sample time)
xxx_15_min is around 50kB (2 READINGS900 x 1 second samples)

EVENT ,2017/01/04,04:42:32,0.668334,"FTP DATA DISCARDED (queue overflow): 172.16.52.210, Tanguisson_15_MIN_24H.csv"

EVENT ,2017/01/04,04:42:36,0.705688,"FTP DATA DISCARDED (queue overflow): 172.16.52.210, tng_3h.csv"

EVENT ,2017/01/04,04:42:41,0.282958,"FTP DATA DISCARDED (queue overflow): 172.16.52.210, tng_24h.csv"

EVENT ,2017/01/04,04:42:41,0.912475,"FTP DATA DISCARDED (queue overflow): 172.16.52.210, tng_7d.csv"

EVENT ,2017/01/04,04:42:42,0.717895,"FTP DATA DISCARDED (queue overflow): 172.16.52.210, tng_31d.csv"

Hi Paul,

When FTP transfer failed, the session will stay in the queue.
And if the queue is full, there will be no new FTP transfer.
New dEX program creation will not delete this queue, so you have to manually delete this from Command Interface (dEX Home - Monitor the Logger - Command) by sending SESSION CLEAR.

Best regards,
Rudy Gunawan

Hi Rudy,

Thank you for the information on the SESSION CLEAR command. Issuing the command i get the following DT80> Prompt returned and the channels continue to display as normal

SESSION CLEAR
DT80>
DT80> V(S6)_TNG (1S) 2110.0 V
I(S6)_TNG (1S) 865.2 mA

I have checked the FTP cue and it is not full.

29SV report 2 as last FTP completed each time

The problem is that is it FTP ing a file, the file only contains the header from the logger with time stamp and TZ, Channel Titles but no data. Every time this happens the log file reports that it can not access the storefile as the below Error log shows.
Saving the Config clears the problem for some time then i get the E118 E110 error messages and only the FTP file containing the header is transferred.
I have also removed the larger ftp files from being transferred and still get the error. The file size is less than 100kB for transfer , the average transfer time is around 5 seconds with all the FTP handshaking.

EVENT ,2017/02/26,08:26:16,0.171630,"Beginning entry of job "CONFIG""
EVENT ,2017/02/26,08:26:20,0.351440,"Loaded job "CONFIG""
EVENT ,2017/02/26,22:01:28,0.772338,"E118 - Error accessing drive B: Media failure"
EVENT ,2017/02/26,22:01:28,0.885620,"E109 - File IO error: Error Code 14: 'B:\UNLOAD\Tanguisson_PFE_1_15_MIN_20170226T220121.csv'"
EVENT ,2017/02/26,22:01:29,0.121826,"E110 - Error accessing storefile: 'B:\JOBS\CONFIG\A\DATA_A.DBD' (242/16777215)"
EVENT ,2017/02/26,22:02:00,0.226440,"E110 - Error accessing storefile: 'B:\JOBS\CONFIG\E\DATA_E.DBD' (242/16777215)"
EVENT ,2017/02/27,22:29:33,0.410888,"Beginning entry of job "CONFIG""
EVENT ,2017/02/27,22:29:37,0.755249,"Loaded job "CONFIG""

Thanks
Paul

Hi Paul,

Please check the status of CF card, possibility of having bad sector or corrupted database.
Reformat it and resend the program again.

Best regards,
Rudy Gunawan

Its been a while since i visited this problem, Have reformatted the flash card and reloaded firmware and configs. It seems to have fixed the issue so far.. One month and no FTP failures. Will continue to monitor.
Thanks
Paul

Thanks for the update Paul,

Best regards,
Rudy Gunawan