Mark 5 module recovery

This page can't be edited. | Page History
    Table of contents
    You are currently comparing two old versions - only when you are comparing against the latest version can you revert. Return to version archive.

    Combined revision comparison

    Comparing version 18:11, 23 Jan 2019 by jwagner with version 18:15, 23 Jan 2019 by jwagner.

    ...

    The disks of the module should appear as blank drives without partitions:

    ...

    A recovery script now found in the DiFX repository (https://svn.atnf.csiro.au/difx/sites/MPIfR/mark5/mark5_scan_recovery.py) can be used to gather data from the drives, and write out recovered VDIF or Mark5B data files. A fill pattern (0x11223344) is inserted in place of missing data, identical to the formerly proper behaviour of the old Conduant card firmware.

    Data from the drives can be recovered as follows:

    dhcp30222:/mnt/sshfs # ~/mark5_scan_recovery.py /dev/sd{b,c,d,e,f,g}
    Module has VSN NRAO+338/16000/2048
    Module has 233 scans in the Mark5B/5C-type user directory
    The original module seems to have recorded onto 8 disks
    Module disk #0 --> None
    Module disk #1 --> <open file '/dev/sdb', mode 'rb' at 0x7feb35d72150>
    Module disk #2 --> <open file '/dev/sdc', mode 'rb' at 0x7feb35d721e0>
    Module disk #3 --> <open file '/dev/sde', mode 'rb' at 0x7feb35d72300>
    Module disk #4 --> None
    Module disk #5 --> <open file '/dev/sdd', mode 'rb' at 0x7feb35d72270>
    Module disk #6 --> <open file '/dev/sdf', mode 'rb' at 0x7feb35d72390>
    Module disk #7 --> <open file '/dev/sdg', mode 'rb' at 0x7feb35d72420>
    output_write() at module offset 73426876176, completed scan 0, leftover 37960 byte to next scan
    output_write() at module offset 129076726760, completed scan 1, leftover 34400 byte to next scan
    output_write() at module offset 208300471928, completed scan 2, leftover 11824 byte to next scan
    ..

    dhcp30222:/mnt/sshfs # ls -al recovered | less
    total 219278081
    drwxr-xr-x 2 oper oper         233 Jan 23 16:31 .
    drwxr-xr-x 4 oper oper           7 Jan 23 16:31 ..
    -rw-r--r-- 1 oper oper 73426874368 Jan 23 16:45 GG081C_HN_No0143.vdif
    -rw-r--r-- 1 oper oper 55649820672 Jan 23 16:55 GG081C_HN_No0173.vdif
    -rw-r--r-- 1 oper oper 79223713792 Jan 23 17:10 GG081C_HN_No0174.vdif
    -rw-r--r-- 1 oper oper 16206467072 Jan 23 17:13 GG081C_HN_No0175.vdif
    ...

    ...

    Other changes:

    1. /body/p[6]/a/@class: " external""external"

    Version from 18:11, 23 Jan 2019

    This revision modified by jwagner (Ban)

    ...

    The disks of the module should appear as blank drives without partitions:

    ...

    Version as of 18:15, 23 Jan 2019

    This revision modified by jwagner (Ban)

    ...

    A recovery script now found in the DiFX repository (https://svn.atnf.csiro.au/difx/sites/MPIfR/mark5/mark5_scan_recovery.py) can be used to gather data from the drives, and write out recovered VDIF or Mark5B data files. A fill pattern (0x11223344) is inserted in place of missing data, identical to the formerly proper behaviour of the old Conduant card firmware.

    Data from the drives can be recovered as follows:

    dhcp30222:/mnt/sshfs # ~/mark5_scan_recovery.py /dev/sd{b,c,d,e,f,g}
    Module has VSN NRAO+338/16000/2048
    Module has 233 scans in the Mark5B/5C-type user directory
    The original module seems to have recorded onto 8 disks
    Module disk #0 --> None
    Module disk #1 --> <open file '/dev/sdb', mode 'rb' at 0x7feb35d72150>
    Module disk #2 --> <open file '/dev/sdc', mode 'rb' at 0x7feb35d721e0>
    Module disk #3 --> <open file '/dev/sde', mode 'rb' at 0x7feb35d72300>
    Module disk #4 --> None
    Module disk #5 --> <open file '/dev/sdd', mode 'rb' at 0x7feb35d72270>
    Module disk #6 --> <open file '/dev/sdf', mode 'rb' at 0x7feb35d72390>
    Module disk #7 --> <open file '/dev/sdg', mode 'rb' at 0x7feb35d72420>
    output_write() at module offset 73426876176, completed scan 0, leftover 37960 byte to next scan
    output_write() at module offset 129076726760, completed scan 1, leftover 34400 byte to next scan
    output_write() at module offset 208300471928, completed scan 2, leftover 11824 byte to next scan
    ..

    dhcp30222:/mnt/sshfs # ls -al recovered | less
    total 219278081
    drwxr-xr-x 2 oper oper         233 Jan 23 16:31 .
    drwxr-xr-x 4 oper oper           7 Jan 23 16:31 ..
    -rw-r--r-- 1 oper oper 73426874368 Jan 23 16:45 GG081C_HN_No0143.vdif
    -rw-r--r-- 1 oper oper 55649820672 Jan 23 16:55 GG081C_HN_No0173.vdif
    -rw-r--r-- 1 oper oper 79223713792 Jan 23 17:10 GG081C_HN_No0174.vdif
    -rw-r--r-- 1 oper oper 16206467072 Jan 23 17:13 GG081C_HN_No0175.vdif
    ...

    ...