diff options
| author | Philip Sargent <philip.sargent@klebos.com> | 2022-03-24 20:59:36 +0000 |
|---|---|---|
| committer | Philip Sargent <philip.sargent@klebos.com> | 2022-03-24 20:59:36 +0000 |
| commit | 3617f9b6d9146f9f6955e604b209244ef9c2ee21 (patch) | |
| tree | c6dfde5dca8c49afbdd534ea55e39d760e372173 /parsers/logbooks.py | |
| parent | 158918898873e6d6c409da63833d1cb1f4f99758 (diff) | |
| download | troggle-3617f9b6d9146f9f6955e604b209244ef9c2ee21.tar.gz troggle-3617f9b6d9146f9f6955e604b209244ef9c2ee21.tar.bz2 troggle-3617f9b6d9146f9f6955e604b209244ef9c2ee21.zip | |
bugfix and docum
Diffstat (limited to 'parsers/logbooks.py')
| -rw-r--r-- | parsers/logbooks.py | 7 |
1 files changed, 3 insertions, 4 deletions
diff --git a/parsers/logbooks.py b/parsers/logbooks.py index 4ebfe0a..9d1a8f0 100644 --- a/parsers/logbooks.py +++ b/parsers/logbooks.py @@ -32,20 +32,19 @@ todo=''' -- far too many uses of Django field dereferencing to get values, which is SLOW - - Loogbooks 1987, 1988, 1989 all crash on MySql - but not sqlite - with db constraint fail. Edit logbook to fix. - import/parse/re-export-as-html the 'artisanal-format' old logbooks so that we keep only a modern HTML05 format. Then we can retiure the old parsers and reduce the volume of code here substantially. -- edit LoadLogbooks() to use coroutines to speed up import substantially, - but perhaps we had better profile it first? - - rewrite to use generators rather than storing everything intermediate in lists - to reduce memory impact. - the object store will need additional functions to replicate the persontrip calculation and storage. For the moment we leave all that to be done in the django db + Concurrent synchronisation would be nice.. + +- DB lock currently prevents multiple threads for loading logbooks. But asyncio might work..? - We should ensure logbook.html is utf-8 and stop this crap: file_in = open(logbookfile,'rb') |