109 lines
6 KiB
Text
109 lines
6 KiB
Text
# Target-language (ru) readability checker DATA (pair-14 data-out): the wordlists and DETECTION patterns the
|
||
# TARGET-GENERAL checkers/sanitizer run on ANY →ru output (regardless of source pair). Engine/target data —
|
||
# a no-langpack →ru book (the ja→ru golden) still runs these — so it is embedded here, not a book pack; the
|
||
# checker/sanitizer ALGORITHMS stay generic Go. `category<TAB>value`; value VERBATIM (a regex or a literal);
|
||
# lines are grouped by category IN ORDER (order matters for the sanitizer preamble preview). Add a target =
|
||
# add data/target-<tgt>.txt + its accessor entry.
|
||
#
|
||
# broken-word: a Russian word ending in this suffix is a mangled infinitive (no valid word ends in «-йть»).
|
||
broken_suffix йть
|
||
# speech-verb attribution: the verbs that make a chevron-quoted line SPOKEN dialogue rather than a
|
||
# thought. The dialogue-dash MIXING rule counts a chevron line only when its attribution carries one of
|
||
# these, i.e. the DEFAULT for an unrecognised attribution is "not a style clash" — precision over recall,
|
||
# the gate's stated bias. The inverse list (thought verbs) was tried first and proved unbounded: a live
|
||
# 2-chapter run immediately produced «понимал» and «размышлял», which no enumeration of thought verbs
|
||
# would have covered, while the speech-verb side is small and closed. Lower-cased, substring match.
|
||
speech_verb сказал
|
||
speech_verb сказала
|
||
speech_verb ответил
|
||
speech_verb ответила
|
||
speech_verb спросил
|
||
speech_verb спросила
|
||
speech_verb крикнул
|
||
speech_verb крикнула
|
||
speech_verb воскликнул
|
||
speech_verb воскликнула
|
||
speech_verb прошептал
|
||
speech_verb прошептала
|
||
speech_verb пробормотал
|
||
speech_verb пробормотала
|
||
speech_verb проговорил
|
||
speech_verb проговорила
|
||
speech_verb продолжил
|
||
speech_verb продолжила
|
||
speech_verb добавил
|
||
speech_verb добавила
|
||
speech_verb возразил
|
||
speech_verb возразила
|
||
speech_verb позвал
|
||
speech_verb позвала
|
||
speech_verb объявил
|
||
speech_verb объявила
|
||
speech_verb произнёс
|
||
speech_verb произнес
|
||
speech_verb произнесла
|
||
# inner-speech VETO markers: a qualifier that makes a line inner speech even when its attribution verb
|
||
# is a speech verb — «пробормотал ПРО СЕБЯ» is a thought, not a spoken turn. Checked after speech_verb,
|
||
# so the pair (verb + veto) reproduces the writer's actual intent instead of the verb alone. Found by the
|
||
# 26.07 live verification: it was the single flag surviving on the real 10-chapter export.
|
||
inner_marker про себя
|
||
inner_marker мысленно
|
||
inner_marker в мыслях
|
||
inner_marker себе под нос
|
||
inner_marker в уме
|
||
# yofikator homograph whitelist: е-spellings that are DISTINCT words from their ё-counterpart (все≠всё,
|
||
# небо≠нёбо, берет≠берёт …), so the inconsistency rule must NOT flag «все»+«всё» as one word two ways.
|
||
yo_homograph все
|
||
yo_homograph всех
|
||
yo_homograph всем
|
||
yo_homograph всеми
|
||
yo_homograph небо
|
||
yo_homograph небом
|
||
yo_homograph узнаем
|
||
yo_homograph узнаете
|
||
yo_homograph узнает
|
||
yo_homograph падеж
|
||
yo_homograph падежа
|
||
yo_homograph совершенный
|
||
yo_homograph совершенное
|
||
yo_homograph совершенная
|
||
yo_homograph совершенно
|
||
yo_homograph совершенны
|
||
yo_homograph чем
|
||
yo_homograph тем
|
||
yo_homograph тема
|
||
yo_homograph теме
|
||
yo_homograph темы
|
||
yo_homograph берет
|
||
yo_homograph берете
|
||
yo_homograph берета
|
||
yo_homograph осел
|
||
yo_homograph осла
|
||
yo_homograph ослы
|
||
yo_homograph ослов
|
||
yo_homograph мел
|
||
yo_homograph мела
|
||
yo_homograph лен
|
||
yo_homograph лена
|
||
yo_homograph нес
|
||
yo_homograph несем
|
||
yo_homograph несет
|
||
yo_homograph вел
|
||
yo_homograph ведет
|
||
yo_homograph ведем
|
||
# magnitude_stem: Russian magnitude WORD stem → base-10 exponent, for the number-magnitude gate (a stem
|
||
# covers [base, base+2] since an unseen multiplier can lift it two orders). `magnitude_stem<TAB>stem<TAB>exp`.
|
||
magnitude_stem тысяч 3
|
||
magnitude_stem миллион 6
|
||
magnitude_stem миллиард 9
|
||
magnitude_stem триллион 12
|
||
# sanitizer DETECTION patterns (pair-14 data-out). The sanitizer is isRuTarget-gated, so these are
|
||
# ru-target data; the strip/detect ALGORITHM stays in sanitizer.go. `sanitizer_preamble` is ORDERED
|
||
# (detectLeadingPreamble returns the FIRST match's preview). Values VERBATIM (regexes).
|
||
sanitizer_preamble (?is)^\s*(?:вот|представляю|привожу|держите)\s+[^\n:]{0,40}?(?:отредактированн|исправленн|улучшенн)[а-яё]+\s+(?:перевод|текст|вариант)[а-яё]*[^\n:]{0,120}?:
|
||
sanitizer_preamble (?is)^\s*(?:отредактированн|исправленн|улучшенн)[а-яё]+\s+(?:перевод|текст|вариант)[а-яё]*[^\n:]{0,120}?:
|
||
sanitizer_preamble (?is)^\s*(?:вот\s+)?перевод\s+(?:фрагмента|текста|отрывка|главы|черновика)\s*:
|
||
sanitizer_preamble (?is)^\s*ниже\s+(?:привед[её]н|представлен|дан|след)[а-яё]*\s+[^\n:]{0,40}?(?:перевод|отредактированн|текст)[а-яё]*[^\n:]{0,20}?:
|
||
sanitizer_trailing_note (?i)^[*_>\s-]{0,4}(?:(?:примечани[ея]|заметк[аи]|комментари[йяю]|пояснени[ея]|сноск[аи])\s*:|(?:примечани[ея]|заметк[аи]|комментари[йяю])\s+(?:переводчик|редактор)[а-яё]*|прим\.\s*(?:перев|ред)\.?)
|
||
sanitizer_edit_meta (?im)^[*_>\s-]{0,4}(?:(?:внесённ|внесен)[а-яё]+\s+правк|основн[а-яё]+\s+правк[а-яё]*(?:\s+для\s+справк[а-яё]+|\s*:)|что\s+(?:было\s+)?(?:изменен|исправлен)|список\s+(?:правок|изменений)|список\s+внесённых)
|
||
sanitizer_invalid_sign (?i)(?:^|\P{L})[ъь][а-яё]|[ъь][ъь]
|