August 2011 - EpiData-list - University of Manitoba Mailing Lists

follow up: big data sets
by epidata-list＠lists.umanitoba.ca 06 Aug '11

06 Aug '11

I tried the new Entryclient with two large data sets. Set 1: 500 integer fields, 500 records, uncompressed size: 1.1 MB as .epx 45K as .epz - load the file: 150 seconds - jump from record 1 to last record: 1 or 2 seconds - * to get empty record: 5 seconds - save file: 3 second - load in Analysis (running under Wine, so a bit slower than on an equally powered PC): 5 seconds - freq v500: immediate - no difference with .epz file Set 2: 20 integer fields, 10,560 records, uncompressed size: 1.1 MB - load the file: immediate - jump to end or new record: immediate - load in Analysis: 7 seconds - freq v1: immediate I expect the typical "large" data set would be somewhere between these two. Most large data sets I have used are like Set 2 and have been extracts of national databases. I might use the Entryclient on these, but unlikely. I've seen others using data like Set 1, but never really understood why they used such large data sets as most data items were unused and interesting only in a clinical review of individual subjects. (technical note: time to execute a Javascript loadxml() <500 msec) Jamie

1 2

File size and program freezing
by epidata-list＠lists.umanitoba.ca 02 Aug '11

02 Aug '11

Hello, I was hoping to get an idea for the size of files people are working with in the new EpiData Manager. I am currently trying to work out issues when I try to open a .epx file. The file is quite large at 60,000 Kb. I don't know if the problem is with Manager being able to handle a file of this size, or if the file contains some sort of corruption. The file is quite important, so any feedback or assistance would be most appreciated. Cheers, Jonathan Edwin -------------------------------------------------------------------------------------------------------- Jonathan Edwin Outbreak Management Division Public Health Agency of Canada jonathan.edwin(a)phac-aspc.gc.ca

1 1

Adding sections or fields inEpiData Manager(length/height of dataform)
by epidata-list＠lists.umanitoba.ca 02 Aug '11

02 Aug '11

My understanding of a section is for the logical grouping of a set of questions (such as personal details, which one may wish to password protect, for instance). Such a section may consist of many questions. If that is the case, then it seems reasonable to me that a section could thus take the whole page. Such a section could be just one of many (which may be any size, smaller or bigger), so that indeed one doesn't just have one section. Regards, Neville ----------------------------------------- ************************************************************************** The information contained in the EMail and any attachments is confidential and intended solely and for the attention and use of the named addressee(s). It may not be disclosed to any other person without the express authority of the HPA, or the intended recipient, or both. If you are not the intended recipient, you must not disclose, copy, distribute or retain this message or any part of it. This footnote also confirms that this EMail has been swept for computer viruses, but please re-sweep any attachments before opening or saving. HTTP://www.HPA.org.uk **************************************************************************

1 1

Adding sections or fields in EpiData Manager(length/height of dataform)
by epidata-list＠lists.umanitoba.ca 02 Aug '11

02 Aug '11

Thanks to Jonathan and Jens for their postings. The approach that Jens suggests works for headings and fields as long a section isn't already full-screen. The approach that Jonathan suggests for sections works for the first such section to be created (i.e. the one that extends the height of the dataform). After that (i.e. after having a section which has extended the height so that it is full screen) it doesn't seem possible to add further sections. In such a situation, even pressing shift+5, for instance, puts the heading within that (now full-screen) section, rather than extending the form. I look forward to Jens and his team handling this situation. Regards, Neville ----------------------------------------- ************************************************************************** The information contained in the EMail and any attachments is confidential and intended solely and for the attention and use of the named addressee(s). It may not be disclosed to any other person without the express authority of the HPA, or the intended recipient, or both. If you are not the intended recipient, you must not disclose, copy, distribute or retain this message or any part of it. This footnote also confirms that this EMail has been swept for computer viruses, but please re-sweep any attachments before opening or saving. HTTP://www.HPA.org.uk **************************************************************************

1 1

Adding sections or fields in EpiData Manager
by epidata-list＠lists.umanitoba.ca 02 Aug '11

02 Aug '11

When creating a form in the Manager, such a form will, generally, contain many fields and possibly more than one section. It is not clear to me how one adds sections and/or fields upon reaching the bottom of the screen (which seems to occur at a height of about 610 as measured from the top) as there is no vertical scroll bar to move a blank page into focus into which such fields or sections can be added. If this can't be done, then surely this limits how many sections and fields can be created. The sample file, for instance, spreads over two pages, so how were the later sections added after the first few were created? Apologies if a stupid question ... All thoughts on this would be most appreciated. Neville ----------------------------------------- ************************************************************************** The information contained in the EMail and any attachments is confidential and intended solely and for the attention and use of the named addressee(s). It may not be disclosed to any other person without the express authority of the HPA, or the intended recipient, or both. If you are not the intended recipient, you must not disclose, copy, distribute or retain this message or any part of it. This footnote also confirms that this EMail has been swept for computer viruses, but please re-sweep any attachments before opening or saving. HTTP://www.HPA.org.uk **************************************************************************

1 2