You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
Dnomd343 d657de835f feat: start handle `rc-2` 2 years ago
assets file: add metadata and cover photo 2 years ago
crawler_release chore: file structure 2 years ago
release feat: start handle `rc-2` 2 years ago
sample update: rename `release` to `replenish` 2 years ago
src feat: banned list search script 2 years ago
.gitignore chore: ignore idea folder 2 years ago
README.md docs: update README.md 2 years ago
xxrs.json file: xxrs json release 2 years ago
xxrs.txt file: release `xxrs.txt` 2 years ago

README.md

栩栩若生

  graph LR
    subgraph crawler
      source_1([108shu.com])
      source_2([aidusk.com])
      source_3([ixsw.la])
      source_4([m.wxsy.net])
      source_5([wxsy.net])
      source_6([xswang.com])
      source_7([zhihu.com])
    end

    subgraph sample
      subgraph raw
        s1a_raw{{sample_1-a}}
        s1b_raw{{sample_1-b}}
        s2a_raw{{sample_2-a}}
        s2b_raw{{sample_2-b}}
        s3_raw{{sample_3}}
      end

      subgraph combine
        s1_combine[sample_1]
        s2_combine[sample_2]
        s3_combine[sample_3]
      end

      subgraph fixed
        s1_fixed(sample_1)
        s2_fixed(sample_2)
        s3_fixed(sample_3)
      end

      subgraph replenish
        sa{{sample_a}}
        sb{{sample_b}}
      end

      source_1 ==> s1a_raw
      source_2 ==> s1b_raw
      source_3 ==> s1b_raw
      source_4 ==> s2a_raw
      source_5 ==> s2a_raw
      source_6 ==> s2b_raw
      source_7 ==> s3_raw

      s1a_raw -- replenish --> s1_combine
      s1b_raw --> s1_combine
      s2a_raw -- replenish --> s2_combine
      s2b_raw -- replenish --> s2_combine
      s3_raw -- clean up --> s3_combine

      s1_combine -- fix --> s1_fixed
      s2_combine -- fix --> s2_fixed
      s3_combine -- fix --> s3_fixed

      s1_fixed --> sa
      s2_fixed -- replenish --> sa
      s2_fixed -. restore .-> sb
      s3_fixed -- replenish --> sb
    end

    subgraph release
      rc-1([rc-1])

      sa --> rc-1
      sb -- fix --> rc-1
    end

数据来源

样本分析

爬虫七个网站的数据,获得五份三组不同的 raw 样本:

  • sample_1-a

  • sample_1-b

  • sample_2-a

  • sample_2-b

  • sample_3

经过简单合并后可得到三份初始 combine 样本:

  • sample_1

  • sample_2

  • sample_3

进行对照合并,修复各类语法词汇错误、违禁屏蔽词等,得到三组 fixed 样本,再次合并,获得两份 release 样本:

  • sample_a

  • sample_b

两组样本只有微小的分隔区别,经过修复合并后得到 RC 样本。

数据发布

  • RC-1 :初始合并版本