Skip to content
This repository has been archived by the owner on Mar 10, 2023. It is now read-only.

使用Redis避免内容重写 #14

Open
gricn opened this issue Sep 7, 2021 · 0 comments
Open

使用Redis避免内容重写 #14

gricn opened this issue Sep 7, 2021 · 0 comments
Labels
enhancement New feature or request

Comments

@gricn
Copy link
Member

gricn commented Sep 7, 2021

  1. 根据URL发布日期这2项指标判断数据库是否已有该网页内容。
  2. 增加参数判断是否要覆写。(覆写利于替换错误格式的内容)

用Redis是因为Elasticsearch写入性能和查找性能不及Redis

@gricn gricn added the enhancement New feature or request label Sep 7, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant