- EpiData-list - University of Manitoba Mailing Lists

New (experimental) version of rewritten Analysis 0.8.4.0
by EpiData development and support 13 Oct '17

13 Oct '17

Today a public test version of rewritten Analysis was made available for Windows and Linux. (v0.8.4.0) Test versions are available as packed archives from: http://epidata.dk/testing.php (at the bottom) Extract the files provided and maintain the folder structure. We are rapidly approaching a version, which can be used in the management for real projects. But for a while still please only use for testing. Start epidataanalysis (exe) and see help menu "Commands Overview". The file shown is commands.html . Also study the "How_to_adapt_your_pgm_file_to_new_EpiData_Analysis_format.pdf" found in the docs folder. Our aim is to change as little as possible in the final syntax, but some changes are necessary due to demands when we write the software for more operating systems (currently Linux and Windows - Mac version will come). The main changes to the command syntax are: 1. use ; at the end of a command in a pgm file 2. use := to give variables a new content . e.g. v1 := 10; 3. options are indicated with ! instead of /, e.g. freq v1 !cum ; means age !t; 4. filenames must contain extension, and enclosed in "projectmain.epx". 5. Similar aspects are grouped, e.g. list data; list variables; list datasets 6. Defining and editing variables, labels etc have a common structure: new var; edit var; drop var; 7. Many additions allow comprehensive programming A major strength of the new analysis is that you may read and save datafiles in csv, dta (stata), epz and epx format directly. You may also read the classic rec files. All executed commands are saved in a pgm file defined by the user. Reading, editing and saving now supports encrypted data, user logged data and files containing related datasets . We know of some issues and bugs in the software released today, but decided to release at this point, since we need more input to remove all bugs at the detailed level. We have almost 300 validation tests and only one special error. Comparison with standard estimates show precision with difference from correct result at -2.06197786709744*E-12 . This is a very promising precision. Examples of known issues are that cycle is not corrected after modifying data, or errors in special types of "for ....to..." loops. If problems arise please report to this list. But make sure you WORK on COPIES OF DATA. Commands and statements added recently : * "append" and "merge" handles related datasets * "check" command with 4 sub commands: data, key, relate or study (document data content, e.g. "check key id visitdate" will tell if there is a unique key for id+visitdate) * "reorder" variables command * "reset" command * read and save files with extended login and user protection defined. * drop data , including remove records marked for deletion * control of fonts, including ability to set your own default by saving to "startup.pgm" * "set" options added recently: - EDITOR and OUTPUT FONT + SIZE: to adjust fonts and size - OUTPUT VIEWER: controls what type of output is generated. text or html is supported - INCLUDE DELETED: controls if records marked for deletion is part of the dataset - SET FORMAT VARIABLE LABEL and - SET FORMAT VALUELABEL: controls default option for value / variable text Many other issues managed: * enhanced and informative feedback in more situations (more indirect help) * run commands in "startup.pgm" on initiation of the program. (Placed in same folder) * Dragging files (data or .pgm) onto the program either opens the file or executes the .pgm * Variables can now be expanded using modifiers like "*", "?" or "-" , e.g. list variables v* * Extended editor with more functionality * F1....F12 function keys work as in Classic EpiData Analysis (except F2) Please test and challenge function. Jens Lauritsen and Torsten Christiansen EpiData Association Denmark

1 0

Difficulty in Importing Relational database of Classical epidata into Epidata Manager
by EpiData development and support 09 Oct '17

09 Oct '17

Dear Jens,                    I am trying to import Classical Epidata Relational File System of 8 tables into Epidata EntryClient.The structure is as follows;                 Family                                                Eligible Couple                                                                                                  Pregnant                                                                        Contra           Under five                             Agesex                                                                                                                Growth Monitoring                                                                            Tuberculosis                                     We  can import Family,  Eligible couple AgeSex and tuberculosis structure data files easily and link also .However the files linked to eligible couple ; Pregnant , Contra , Under five and Growth monitoring , only the structure of the file is imported, NOT DATA.  When we click the data check button in the Import Dialogue Box, it shows the following error .“Importing data is only impossible when the imported dataset has same variable (names +type) as  the defined variables!”That is already the case. The primary key between family and other  directly linked files is “FFNO” , a text variable . The primary key between Ecouple  and linked files is “FAMIDNUM”  a numeric  variable.  The primary key between Underfive and Growth monitoring files  is “Card2” , a numeric variable .  The number of records are in thousands.I am using the latest version of Epidata Manager and EntryClient.Why we are not able to import the data of Pregnant , contra , Under five and Growth monitoring files. Please guideDr. Shavinder Singh   

1 1

Epidata 3.1 and Windows 10
by EpiData development and support 23 Aug '17

23 Aug '17

Hello, My organization has been testing Epidata 3.1 for compatibility with Windows 10 before we upgrade our network OS, I encountered the following issue: if a change is made to an existing QES file, the process of revising the existing REC file stalls and can take 7-10 minutes to complete. This is very unusual since the process is virtually instantaneous in Windows 7 or previous OS versions. The IT staff haven't found a solution. I'm hoping someone here might have a suggestion (configuration, network setting?). Thanks Rod Rod Asplin, C.P.H.I. (C) Environmental Health Officer Communicable Disease Control Fraser Health Authority

1 0

Do not apply checks
by EpiData development and support 21 Aug '17

21 Aug '17

While I try to apply checks I got the following lines always appeared error Can any one tell me what is wrong with the following variable names Unknown label name or field name in line 24: COMMENT LEGAL USE label_cohort Unknown label name or field name in line 34: COMMENT LEGAL USE label_n102marita Unknown label name or field name in line 39: COMMENT LEGAL USE label_n103educat Thank You Very Much Fekadu

1 1

Problem with AUTOSEARCH
by EpiData development and support 20 Aug '17

20 Aug '17

Dear friends, When I enter a duplicate data in a field configured with autosearch, the dialog box displays three option buttons: YES, NO and CANCEL. When pressing the NO button, nothing happens but the other options work normally. The other dialog boxes similar to this one are working normally. Does anyone know if this is a bug in EpiData (Classic) Entry v3.1? How can I resolve this? I need to set up a variable like AUTOSEARCH varID varPERSON. Where varID is the identification variable and varPERSON is the number given to each person in the household. Grateful for attention! Márcia

1 0

Reg Epidata Manager 4.0.2.101
by EpiData development and support 03 Aug '17

03 Aug '17

This is a very basic question. 1) I am not able to automatically calculate the number of hours from the calculate option. I have input date and time and entered it into the calculate option but it is not giving me the correct answer. e.g. I have input date of injury and time of injury; and date of presentation and time of presentation. I need to calculate the number of hours of delay in presentation. I am not able to do that. 2) Is it possible to change the time option and exclude the seconds? Thank you, With regards, Madhurita

1 3

error message
by EpiData development and support 21 Jul '17

21 Jul '17

Dear all When comparing two datasets with Epidata Manager (double entry) I receive the error: "index out of bounds 108". Does somebody know what this means? Thank you very much, Nicole Dr. med. Nicole Bender Senior Research Fellow Evolutionary Morphology and Adaptation Group Institute of Evolutionary Medicine (IEM) University of Zurich Winterthurerstrasse 190 CH-8057 Zurich, Switzerland Office Y42 G86b Phone +41 44 635 05 31, Fax: +41 44 635 57 02 nicole.bender(a)iem.uzh.ch http://www.iem.uzh.ch/en/people/admin/Nicole-Bender.html

1 4

Read and Merge “rec” file commands and few suggestions in New Epidata Analysis (0.7.3.0)
by EpiData development and support 09 Jul '17

09 Jul '17

Dear Jens,                                     It is heartening to see the Epidata Analysis development progressing. Our favourite “qes/chk/rec” file  systm  seems fading  on the horizon. Our old applications are still functional in Classic Epidata Entry. It is comparatively easy to upgrade to the new”epx” file if one is using the FLAT file. However, the relational “rec” files cannot be upgraded to the new  ”epx” file. There was a line written in the mail that  one can read “rec” file but not write it in the new Epidata Analysis. Hence I request you to kindly preserve the read and merge (rec files) commands in the new Epidata Analysis.The Command and Function Reference Guide 2.1 is fairly exhaustive. Command “Merge” is perhaps not introduced in the prototype version, hence not mentioned in the Command and Function Reference Guide.It is possible to generate by the available Graphics in the Epidata Analysis ver 2.2.3 (build 187) by command syntax  generated by using  “Diaglogue boxes”.  Available options in the graphical output are excellent. However some tweaking is still required to get the final graph. PGMs is a wonderful feature with infinite possibilities. Gratitude to Epidata team for the sustained effort .With regards,Dr.  Shavinder Singh 

1 0

Test version of new EpiData Analysis released (v0.7.0.3) - please assist in testing.
by EpiData development and support 08 Jul '17

08 Jul '17

Exciting News Today we have released a test version of the rewritten analysis, which for the first time approaches functionality resembling the final first version to be released later. You may download the test version from http://www.epidata.dk/testing.php Please notice that it is still premature to use the new analysis for production every day use, but we urge users to challenge the new analysis. You could for instance replicate data-management procedures you do with ordinary Classic Analysis v2.2. rel 3 (Build 187) The intention is to release the new analysis for production when the following has been developed: A: all functionality for data management (new projects, new variables, labels and editing of these). B: append and merge. C: basic reporting - e.g. for logfile overview Already now you may test many of these aspects. After download and unzipping (files are provided in zipped archives) you will see the commands and syntax documentation. We attempt to maintain the same syntax that you know, but to allow for the modernization some changes are needed: e.g. read and write epx, csv and dta files ; work on all operating systems (Linux, Mac, Windows) ; accept UTF-8; extend with special functions; sort data; manage encrypted data. You can read rec files, but not write them. Use epx for saving data. We also aim for standardization across commands. E.g. number of decimals in output is always !Dx, where x is the number of decimals 0,1,2 etc. For data analysis these commands are implemented: count , means, freq, Some changes: use := instead of = . Put texts in " " . End all command lines with ;. Selection works on a single block. Options are mentioned with ! instead of /. Some enhancements: A copy of all executed commands is saved (commandlog.pgm). Recent pgm in editor filelist. Multiple pgm sorting ascending and descending and more. See datasets (F2) in a project. Open encrypted files. A frequency table of v17: freq v17 !vl !cum ; // would show labels and values plus cumulative percentage. To do the same table among those younger than 40 with no decimals. select (age < 40) do freq v17 !vl !d0; To remove all observations with age above 68. Use the command drop: select (age> 68) do drop data; A new construct is a loop, e.g. : new global integer i ; for i:=1 to 5 do ? "This is a number counting: " + i ; Which can be used to show means or frequencies for subgroups of another variable: new global integer i ; for i:= 1 to 5 do select (area = i) do means age !by:=sex !t; Please challenge function within WHAT is already implemented. Also notice that output format is still rather crude. Rest assured more will come during autumn. But do remember that you should NOT use production data - work on copies of real data. Please also discuss function and problems on this list. Best wishes for fruitful testing Torsten Christiansen Jens Lauritsen EpiData Association, Denmark

1 1

Updated versions of EntryClient and Manager (4.2.0.0)
by EpiData development and support 21 Jun '17

21 Jun '17

For all list users. We have released next versions of EpiData Manager and Entryclient: Major news: 1 Saving data is now per observation. The principle of writing data was changed completely. From this version onwards all changes to single observations (records) are saved after the user responds "Yes" to the question of saving of that observation on a given dataform. All saving to disk is performed in the background, such that entry can continue. But all data are still in memory, such that speed of browsing etc should be the same. A visual feedback button indicates current state: green = current state is saved correctly yellow = save in progress red = error in save. The user most intervene if this persists. The "red state" could occur if you loose connection to a network drive, e.g. due to time-out failure. In such cases the user can save a copy of the project with EntryClient ("save as" in the file menu). It is the responsibility of the user to secure proper handling afterwards, e.g. decide with a manager what should happen. To find out which project file is optimal for continued entry the "count observations/records by id" function in Manager - documentation, is a good way to get an overview. 2 Status bar have new common items. Make sure to get a new "default status bar" to see this. (default preferences) 3 Valuelabels are now possible for Date and Time variables. 4 A number of bugs have been fixed in relational data and other special situations. 5 Implementation of logging: extended access The content of the logfile system is now a standard dataform within the project. If a user have administrative rights the log file content can be seen in Manager, for all other users it is hidden. This allows analysis and export of the data in a logfile. All writing to the logfile is performed in the background, such that it does not interfere with ongoing entry. The logging function allows assessment of which users had access to data, at what time and see before/after values if an observation was edited after first save. For details, see the specific texts: Manager:http://epidata.dk/epidatamanager.changelog.txt EntryClient:http://epidata.dk/epidataentryclient.changelog.txt Common functions:http://epidata.dk/epidatacore.changelog.txt Unfortunately we have discovered a few bugs after the first (4.2.0.0) elease, so please make sure to download and install again if you have downloaded the new version before the 21st of June. Please verify that your changes to data are actually saved, We have obviously tested the new "save each observation" principle "in-house", but there could be examples in which this is not working correctly. Do not hesitate to report problems to this list or < info at epidata.dk > Development continues with re-writing analysis for complete data-management features. The new analysis can read the logfiles created with extended access. Expected to be available for all users in open testing within a few weeks. After that we will continue with implementation in EntryClient of extended scripting during entry. Please consider adding funding to cover development - e.g. at the level of what alternative software acquisitions would have cost. The funding principle continues as "attain funding-release without fee-release as open-source when we have completed development". Always acknowledge those giving funding (see http://www.epidata.dk/credit.htm and http://www.epidata.dk/funding.htm) We need help in creation of sample cases that could be used as part of the quality assurance programme. Currently the testing is thorough for Manager and Analysis, but still not sufficient for EntryClient. best wishes Jens Lauritsen & Torsten Christiansen EpiData Association Denmark

1 0