[JOSS] Paper Feedback

[jansim]

Here's a list of feedback points regarding the paper:

• I find the use of the term alignment a bit surprising, is this commonly used when matching a taxonomy?
• "The challenge is compounded by the absence of integrated tooling that combines skill identification with alignment to recognized taxonomies, forcing researchers to assemble fragile multi-tool pipelines." [L26] this claim seems not well supported?
• The paper does not seem represent to the state of the field very well, with several other projects combining LLMs and skill extraction. From a quick search there seem to be multiple works that should be referenced (judging only by their abstracts).
  • Taking only the first 4 results: e.g. https://arxiv.org/abs/2304.11060, https://www.sciencedirect.com/science/article/pii/S2665963825000326, https://arxiv.org/abs/2410.12052, https://aclanthology.org/2024.nlp4hr-1.3/, ...
• Parts of the paper read very AI-generated, esp. the Software Design section e.g. L90+. This is not just about style (and respect for people reading the paper), but it also negatively affects the readability of the paper. That section should be rewritten to more clearly describe what actually happens.
  • I want to give the benefit of the doubt here, but the AI statement "The paper text was drafted by the authors with AI-assisted editing for clarity." feels a bit misleading here and it feels much more like at least portions of the paper were AI-generated? Curious for @muctadir 's experience regarding this.
• The research impact statement is strong!
• Please link the cookbook repository mentioned in the paper
• L29 LAiSER claims accurate extraction, but there does not seem to be any evaluation of the tool available? I think an evaluation could be very helpful, but it's also not necessarily required for a paper like this, but then the language should be watered down here.

And one minor issue I noticed in the documentation:

• The https://www.openskillsnetwork.org/ link is broken

[jansim]

Related to openjournals/joss-reviews#10421