Forum archive 2000-2006

ymarkov - courseName/html/tmp/ size restrictions?

ymarkov - courseName/html/tmp/ size restrictions?

by Arnold Pizer -
Number of replies: 0
inactiveTopiccourseName/html/tmp/ size restrictions? topic started 9/17/2002; 5:26:18 AM
last post 9/23/2002; 4:09:09 PM
userymarkov - courseName/html/tmp/ size restrictions?  blueArrow
9/17/2002; 5:26:18 AM (reads: 1610, responses: 7)
Does anyone know if the following sample size (in # of files) of a CourseName/html/tmp/ directory could be a problem for WebWork?

30,000 ( 200 students * 15 prob. * 10 (l2h generated) pictures per problem)

It have not been a problem up to now, but we are trying to troubleshoot a Webserver problem.

Thanks, Yavor Markov

<| Post or View Comments |>


userJohn Jones - Re: courseName/html/tmp/ size restrictions?  blueArrow
9/17/2002; 8:55:33 AM (reads: 1871, responses: 0)
This is close to the limit, if all of the files are in one directory. Bill Z. of Long Beach told me that 32768 was the limit, which he discovered by running into this problem on their server.

Current versions of WeBWorK split the images into subdirectories, so each student (psvn) has its own directory in each problem set. If that is not how your version of WeBWorK is dividing up images, you probably have your problem. It would explain the intermittent nature of the problems, since you are flirting with the limit.

John

<| Post or View Comments |>


userArnold K. Pizer - Re: courseName/html/tmp/ size restrictions?  blueArrow
9/17/2002; 8:59:21 AM (reads: 1885, responses: 0)
This depends on how many inodes your file system has (and probably other factors). We recommend setting up a separate file system with a lot of inodes for any installation with a large number of students. Read "Step 8: Separating out temporary WeBWorK data" from http://webwork.math.rochester.edu/docs/docs/install/setup.html

Hopefully someone with "systems" expertise can give Yavor a more specific answer.

Arnie

PS. I see John got his response in before me. It's good to hear from experts.

<| Post or View Comments |>


userBill Ziemer - Re: courseName/html/tmp/ size restrictions?  blueArrow
9/18/2002; 3:59:26 AM (reads: 1851, responses: 0)
At Long Beach, we ended up splitting classes into 30-50 student sized pieces to cope with the "too many files in tmp" problem. I then wrote a bunch of scripts to do some of the more common professor page items via command line to manage multiple courses. If this is how you solve your problem, I am more than willing to send you the scripts.

I have been running John Jones' dvipng version instead of using latex2html this semester. There have been absolutely no glitches so far (we have a dual 700MHz Xeon CPUs with 1GB RAM Dell server running RedHat 7.0, and about 1000 students). The major advantage is NO MORE PRECREATION! Dvipng is almost as fast as tth.

<| Post or View Comments |>


userymarkov - Re: courseName/html/tmp/ size restrictions?  blueArrow
9/20/2002; 3:46:30 AM (reads: 1865, responses: 0)
Thank you for all suggestions.

On John Jones' note. We run WW 1.7 so images are split in subdirectories by student.

On A. Pizer's note. Definitely something we need to look at. We missed that step 8 in the instalation.

On Bill Ziemer's note. Are you making that version public any time soon?

Thank you again.

<| Post or View Comments |>


userJohn Jones - Re: courseName/html/tmp/ size restrictions?  blueArrow
9/20/2002; 5:52:58 PM (reads: 1855, responses: 0)
Hi,

Dvipng generated images is already available to the public for WeBWorK. Here's some basic information. Using dvipng gives a faster way of generating images in typeset mode. If a single problem has a huge number of images, it is actually faster than tth. For a just couple of images in a problem (which is more typical), it is slower than tth, but still managable.

Dvipng mode will leave its images on the disk and reuse them if they are there. So, the first time a problem is rendered WeBWorK generates the images. Hitting the submit button does need to create them again.

For our system, I have a daily cron job which deletes everything which has not been accessed recently in CourseNames/html/tmp/*, including images produced by dvipng. If a student works on a problem one day, and then comes back 2 days later, we end up regenerating the images. With more students, we might want to clean less frequently, or use a different parameter for "accessed recently" above (I use 20 minutes).

Implimenting this for your system takes two things: replacing relevant WeBWorK files and adding the additional software. The WeBWorK files are all in the Rochester CVS. At this point, I would advise get a whole new set for installation. Dvipng mode is not the only change since 1.7 and changes in one file may require a newer version of another file.

The extra software can be installed separately. It consists of "dvipng" itself, which takes a dvi file and converts each page into a png image, and "preview", which is a latex package that can be used to produce the special dvi file (with one formula per page, and with page sizes cropped tightly to the formulas).

I would recommend installing dvipng/preview first since it will not interfere with current system operation. Depending on how similar your system is to mine, this could take as little as a few minutes (or as long as, well, don't ask). Ultimately, we will have a better installation process. You can download it from

http://hobbes.la.asu.edu/webwork-stuff

It is near the top of the page.

Let me know about successes/difficulties in installing the parts from my page.

John

<| Post or View Comments |>


userArnold K. Pizer - Re: courseName/html/tmp/ size restrictions?  blueArrow
9/22/2002; 8:36:35 AM (reads: 1862, responses: 1)
The option of using dvipng and/or latex2html mode will be included in WeBWorK version 1.8. In addition for dvipng mode you will have to download the dvipng software from John's site http://hobbes.la.asu.edu/webwork-stuff

Arnie

<| Post or View Comments |>


userJohn Labute - Re: courseName/html/tmp/ size restrictions?  blueArrow
9/23/2002; 4:09:09 PM (reads: 2122, responses: 0)
When do you expect version 1.8 to come out? It took 23 hours to precreate for two courses 600 + 400 = 100 students.

<| Post or View Comments |>