I tried the new Entryclient with two large data sets.
Set 1: 500 integer fields, 500 records, uncompressed size: 1.1 MB as .epx 45K as .epz
- load the file: 150 seconds
- jump from record 1 to last record: 1 or 2 seconds
- * to get empty record: 5 seconds
- save file: 3 second
- load in Analysis (running under Wine, so a bit slower than on an equally powered PC): 5 seconds
- freq v500: immediate
- no difference with .epz file
Set 2: 20 integer fields, 10,560 records, uncompressed size: 1.1 MB
- load the file: immediate
- jump to end or new record: immediate
- load in Analysis: 7 seconds
- freq v1: immediate
I expect the typical "large" data set would be somewhere between these two. Most large data sets I have used are like Set 2 and have been extracts of national databases. I might use the Entryclient on these, but unlikely. I've seen others using data like Set 1, but never really understood why they used such large data sets as most data items were unused and interesting only in a clinical review of individual subjects.
(technical note: time to execute a Javascript loadxml() <500 msec)
Jamie
Hello,
I was hoping to get an idea for the size of files people are working with
in the new EpiData Manager.
I am currently trying to work out issues when I try to open a .epx file.
The file is quite large at 60,000 Kb. I don't know if the problem is with
Manager being able to handle a file of this size, or if the file contains
some sort of corruption. The file is quite important, so any feedback or
assistance would be most appreciated.
Cheers,
Jonathan Edwin
--------------------------------------------------------------------------------------------------------
Jonathan Edwin
Outbreak Management Division
Public Health Agency of Canada
jonathan.edwin(a)phac-aspc.gc.ca
My understanding of a section is for the logical grouping of a set of
questions (such as personal details, which one may wish to password
protect, for instance). Such a section may consist of many questions. If
that is the case, then it seems reasonable to me that a section could
thus take the whole page. Such a section could be just one of many
(which may be any size, smaller or bigger), so that indeed one doesn't
just have one section.
Regards,
Neville
-----------------------------------------
**************************************************************************
The information contained in the EMail and any attachments is
confidential and intended solely and for the attention and use of
the named addressee(s). It may not be disclosed to any other person
without the express authority of the HPA, or the intended
recipient, or both. If you are not the intended recipient, you must
not disclose, copy, distribute or retain this message or any part
of it. This footnote also confirms that this EMail has been swept
for computer viruses, but please re-sweep any attachments before
opening or saving. HTTP://www.HPA.org.uk
**************************************************************************
Thanks to Jonathan and Jens for their postings. The approach that Jens
suggests works for headings and fields as long a section isn't already
full-screen. The approach that Jonathan suggests for sections works for
the first such section to be created (i.e. the one that extends the
height of the dataform). After that (i.e. after having a section which
has extended the height so that it is full screen) it doesn't seem
possible to add further sections. In such a situation, even pressing
shift+5, for instance, puts the heading within that (now full-screen)
section, rather than extending the form.
I look forward to Jens and his team handling this situation.
Regards,
Neville
-----------------------------------------
**************************************************************************
The information contained in the EMail and any attachments is
confidential and intended solely and for the attention and use of
the named addressee(s). It may not be disclosed to any other person
without the express authority of the HPA, or the intended
recipient, or both. If you are not the intended recipient, you must
not disclose, copy, distribute or retain this message or any part
of it. This footnote also confirms that this EMail has been swept
for computer viruses, but please re-sweep any attachments before
opening or saving. HTTP://www.HPA.org.uk
**************************************************************************
When creating a form in the Manager, such a form will, generally,
contain many fields and possibly more than one section. It is not clear
to me how one adds sections and/or fields upon reaching the bottom of
the screen (which seems to occur at a height of about 610 as measured
from the top) as there is no vertical scroll bar to move a blank page
into focus into which such fields or sections can be added. If this
can't be done, then surely this limits how many sections and fields can
be created. The sample file, for instance, spreads over two pages, so
how were the later sections added after the first few were created?
Apologies if a stupid question ... All thoughts on this would be most
appreciated.
Neville
-----------------------------------------
**************************************************************************
The information contained in the EMail and any attachments is
confidential and intended solely and for the attention and use of
the named addressee(s). It may not be disclosed to any other person
without the express authority of the HPA, or the intended
recipient, or both. If you are not the intended recipient, you must
not disclose, copy, distribute or retain this message or any part
of it. This footnote also confirms that this EMail has been swept
for computer viruses, but please re-sweep any attachments before
opening or saving. HTTP://www.HPA.org.uk
**************************************************************************