(development site – not for public use – official site: www.nawg.co.uk)

Committee Meeting 26-Feb-2026 Technology Report

Report on Technology for the Committee Meeting on 26th February 2026 by Kevin Machin
Contents
  • Achievements
  • Existing website
  • New website
  • Automatically Generated Directory
  • Analysis and Problems
  • Membership data analysis
  • Membership data integrity
  • Next steps
  • A summary of the progress made since the 10th January 2026 report, along with plans for the next steps.

    There's also a report about the poor state of the membership data. My aim with this is to highlight problems that need fixing, moving forward, rather than to dwell on the past and how the situation came about.

    Achievements

    Existing Website

    Improvements have been made to the writing groups directory page. It's now easier to maintain, though not yet fully automated as planned for the future.

    Points to note…

    New Website

    Progress on the new website proceeds towards a Minimum Viable Product. In particular:

    Automatically Generated Directory

    A tool has been developed, that takes the membership data and uses it to automatically generate the group directory details. This includes the following.

    The tool is mostly finished but, to be honest, the system is not fit for use. This is because the underlying data are in a very poor condition. More about this is explained in the data integrity section in this report.

    Analysis and Problems

    Working on the writing groups directory has led to:

    1. A long look at the way we're recording and manipulating membership data,
    2. The realisation that these data are in poor condition.
    Membership Data Analysis

    Using historical data, an analysis of the NAWG membership was done. This was to look at the trends from around the start of 2015 to the present day. The key findings are as follows.

    The following charts show the trends.

    Membership Data Integrity Issues

    As mentioned in the last section, over the past few weeks, I've been looking at the membership data. The driving reason behind this is to make it easier to keep the writing groups directory area on the website up to date. As I've said in various messages, this was previously a very labour intensive task.

    Work on this goal is progressing well, but along the way I've found some significant issues with the Excel workbook that we use to maintain our membership information.

    1. Hidden rows: Some rows, on several sheets, are hidden. This is a feature of Excel, but not everyone may be aware of it, unless the row numbers sequences are carefully examined.

      The hidden rows are sometimes due to the use of filters (see below), but not in every case. Some sheets have hidden rows with no filters active.

      This is a serious issue, as it essentially means there are data present that we simply may be unaware of.

    2. Data hidden by filters: The documents are often saved with filters still active. This is bad practise, as less experienced users may be unaware that data are hidden.

      Filters are useful while working on the document, but should be cleared before saving and uploading to Dropbox.

    3. Data integrity problems: The quality and integrity of the data in the workbook has degraded over time.

      The issues include, but are probably not limited to, the following (in no particular order, but enumerated for reference).

      1. Duplication: Some sheets have duplicated information in them, e.g. "ExMembers" and "Removed - full details". This is a recipe for errors and inconsistencies.
      2. Schema: There's been copying and pasting all over the shop, by the looks of things. In particular…

        • Data have been copied from one sheet to another, but this synchronisation has not been maintained.
        • Some sheets have duplicate columns, e.g. with the same name and the same data repeated. Again, this is inviting errors and inconsistencies.
        • The "Directory Data" sheet is woefully out of date and out of sync with the "CurrentNames" one. It's clearly been copied at some stage, but not properly maintained.

          Many of the columns are repeated across the sheets, but there are far fewer group entries in the directory one. Plus the identifier numbers don't match up at all.

          The sole purpose of the "Directory Data" sheet seems to be to add columns to the main data but filter out everything except groups. There are much better ways to to this than rely on manual copying. The obvious thing to do to solve this is to move the extra columns back into the main sheet, so there will be no duplication of the primary set of columns.

        No data should be duplicated anywhere; there should be a single source of truth, from which everything is derived. That way, if the source data are changed, then this will properly propagate without anyone having to remember to manually synchronise anything.

      3. Bad postcodes: UK postcodes have a very specific format, but quite a few of them are invalid. This can lead to problems with communication, but also in deriving groups' regional areas.
      4. Incorrectly placed data: Some information is in the wrong cell (row and/or column). Some cells contain their intended data, but with extra information "leaked" from other cells.
      5. Incorrect data in the Type column: This column is highly important, as it's used to determine what kind of membership the row pertains to.

        It should only contain the values: enews, Link, Group, Indv, Patron, Supp. I'm not overly concerned about mixed casings, but misspelled versions are a problem, as are values polluted with other junk.

        There should also be no blank cells in this column. By "blank" I mean empty, or containing only spaces. On the subject of spaces, there are cells (not just in the Type column) that have their data prefixed and/or suffixed with extra padding spaces, probably pasting errors, which stop the filters and sorting features from working properly.

      6. Patrons: Some patrons are deceased, or may have stopped being patrons for other reasons, yet they're still marked as active in the data.

        I'm also unclear as to what the difference between a patron and a supporter is.

      7. General:
        • Some people are down as both current names and as ex-members.
        • We seem to allow more than one contact person per group, one or more of which may or may not be the "financial contact". There's nothing inherently wrong with this but, without a proper explanation to new committee members, these kind of data relationships are not at all obvious.
    4. Useless extra sheets: "Sheet1" is empty. "Sheet2" has irrelevant data: a list of food types.

      These are just clutter, distracting, and a waste of space and bandwidth.

    5. No documentation: There are no instructions in the workbook for how to properly use it, except for some rather cryptic hints in some of the column headings. No documentation in the Dropbox either.

      In particular:

      • No explanation of the data schema, i.e. how the relations are meant to work.
      • No explanation of the correct procedures, neither for working on the document, nor on how to manage the data in the Dropbox. I suspect data could easily be lost if more than one person attempts to make changes without coordination.
      • All sorts of colour coding for cells, rows, columns, with no explanation as to what any of that signifies.

    I propose to clean up the workbook, and perhaps change some of the more awkward ways we store and work with the data, but this is a matter for discussion at the committee meeting.

    We should probably also discuss how to go about agreeing on and documenting the procedures.

    Next Steps

    Author: Kevin Machin ♦ Created: 11-Jan-2026 ♦ Access: public ♦ Article: tech-report-260226 ♦ Topics: technology, committee