zcdsj
/
paper_server
5
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
336 Commits 1 Branch 0 Tags 3.2 MiB
Commit Graph

294 Commits

Author SHA1 Message Date
caoqianming 6a5a5d7b6b feat: paper list 加 pdf_url / xml_url 直链字段 + pg_trgm GIN 索引 
serializers: PaperListSerializer 加 pdf_url / xml_url SerializerMethodField,基于 publication_date + safe_doi 后端拼 absolute_uri;has_fulltext_{pdf,xml}=False 或 publication_date 缺失返空串。LLM 客户端从 list 一次拿到直链,不必拼 URL。
migration 0006: CREATE EXTENSION IF NOT EXISTS pg_trgm + 3 列 GIN 索引(title / first_author / first_author_institution),根治 SearchFilter 跨列 ILIKE '%xxx%' 全表扫 timeout(高频词如 cement 原本 30s+,加索引后几十 ms)。

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-21 13:48:52 +08:00
caoqianming e8320bce05 feat: paper list 返 abstract + 加 retrieve 端点 + filterset 扩 year range / 多字段 
为 zcbot research skill 让出 LLM 友好接口:list 端点带 abstract 省 LLM 逐条 get 的 round-trip;PaperViewSet 加 CustomRetrieveModelMixin 修 GET /api/resm/paper/<id>/ 原本 404 的 bug;filterset_class 扩 publication_year_gte/lte + has_fulltext_pdf / is_oa / publication_name / first_author / openalex_id;queryset 加 select_related("abstract") 防 N+1。search_fields 不动(仍 title/first_author/first_author_institution)。

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-21 13:17:46 +08:00
caoqianming 326f6b35d5 fix: 真正把 paper_pdf_view 从 swagger 端点枚举里剔除 
上一次的 swagger_auto_schema(auto_schema=None) 只抑制 operation 渲染,路径仍进入 endpoints 字典并参与最长公共前缀计算,所以分组依旧塌成 api.改为在 .cls 上设置 swagger_schema = None,命中 EndpointEnumerator.should_include_endpoint 的提前返回(generators.py:66),路径根本不进枚举,公共前缀恢复 /api/.
 2026-05-06 14:28:02 +08:00
caoqianming b8a397eef7 fix: 隐藏 paper_pdf_view 避免 swagger 分组按 api 聚合 
paper_pdf_view 是 @api_view 装饰的非 api/ 前缀路由,会被 drf-yasg 纳入 schema,导致最长公共前缀塌成空,所有接口归到 api 标签下.加 swagger_auto_schema(auto_schema=None) 把它从 schema 中剔除,公共前缀恢复 /api/,分组按模块还原.
 2026-05-06 14:17:57 +08:00
caoqianming b826f8f46b feat: get_paper_meta_from_openalex 添加软停止2 2026-05-06 14:17:22 +08:00
caoqianming 6d2f2a452c Merge branch 'main' of http://gitea.xxhhcty.xyz:8080/zcdsj/paper_server 2026-05-06 13:51:58 +08:00
caoqianming 1d8d829797 feat: get_paper_meta_from_openalex 添加软停止 
Co-authored-by: Copilot <copilot@github.com>
 2026-05-06 13:50:25 +08:00
TianyangZhang 92c55e8691 feat: 修改pdf 验证cloudflare 2026-03-24 10:34:06 +08:00
TianyangZhang 76bb3bb4d4 Merge branch 'main' of http://gitea.xxhhcty.xyz:8080/zcdsj/paper_server 2026-03-23 16:30:21 +08:00
TianyangZhang d7dd606f15 feat：通过cloudflare 验证 2026-03-23 16:30:18 +08:00
caoqianming 4090ce457d feat: downloadpf 先不走openalex 2026-03-11 12:27:58 +08:00
caoqianming b91482609b feat: 添加doi查询条件 2026-03-10 09:33:49 +08:00
caoqianming 54780b8ce1 feat: get_abstract 优化3 2026-02-13 16:18:04 +08:00
caoqianming 38c4d8109b feat: get_abstract 优化2 2026-02-13 16:15:54 +08:00
caoqianming 3d08c4aeee feat: get_abstract 优化 2026-02-13 16:13:56 +08:00
caoqianming 360456b50c feat: get_paper_meta_from_openalex 2026-02-12 14:09:26 +08:00
caoqianming b3ea39757e feat: 优化 get_pdf_from_openalex 2026-02-12 10:25:13 +08:00
caoqianming d5f8e43751 feat: 修改ACCURACY 2026-02-10 16:18:48 +08:00
caoqianming b300c1779b feat: 需要保存openalex pdferror 2026-02-10 14:13:50 +08:00
caoqianming 3c568c076b feat: save_pdf_from_openalex 保存openalex_pdf_not_found 2026-02-10 14:06:33 +08:00
caoqianming 2690895231 fix: timezone bug 2026-02-10 14:03:37 +08:00
caoqianming 5ebf2bde24 feat: get_pdf_from_openalex2 2026-02-10 13:58:13 +08:00
caoqianming 1ddca4d34d feat: get_pdf_from_openalex 2026-02-10 13:56:44 +08:00
caoqianming 76e8204680 feat: 启用save_pdf_from_openalex 2026-02-10 12:16:07 +08:00
caoqianming 352966946e feat: 确保pdf下载完整 2026-02-10 11:14:30 +08:00
caoqianming 0fb8e5ff94 feat: 优化release_working_paper 2026-02-10 10:08:46 +08:00
caoqianming 33afe3af0b feat: save_pdf_from_oa_url 允许202 2026-02-10 09:36:26 +08:00
caoqianming 5dda4efcae feat: 先标记为oa_url_need_play 2026-02-09 16:47:43 +08:00
caoqianming fd16c6f9d2 feat: 函数内导入 2026-02-09 15:34:07 +08:00
caoqianming 94f269626d feat: 添加pyautogui调用 2026-02-09 15:17:02 +08:00
caoqianming 9efc412f7d feat: get_abstract_from_elsevier 先执行混排 2026-02-05 09:14:51 +08:00
caoqianming be264fd558 feat: save_pdf_from_scihub返回信息 2026-02-04 12:47:34 +08:00
caoqianming d7aa8f8ada feat: 优化save_pdf_from_scihub 2026-02-04 11:26:55 +08:00
caoqianming b9f06b4859 feat: 完善get_paper_meata search 2026-02-04 10:01:40 +08:00
caoqianming 76c8748503 feat: 完善get_abstract_from_elsevier 2026-02-04 09:33:45 +08:00
caoqianming 8fbdc7c28b feat: get_abstract_from_elsevier 添加参数 2026-02-04 08:56:13 +08:00
caoqianming 51fc1a5c5a feat: 增加d_scihub 调用2 2026-02-03 15:55:10 +08:00
caoqianming 43e8dbc226 feat: 增加d_scihub 调用 2026-02-03 15:53:13 +08:00
caoqianming 33a6dbf431 feat: 增加d_scihub 2026-02-03 15:41:44 +08:00
caoqianming aa95818414 feat: 支持filter_or 2026-02-03 09:19:53 +08:00
caoqianming 99f9cff9d5 feat: 修改get_abstract_from_elsevier2 2026-02-02 10:26:27 +08:00
caoqianming 82b1b41422 feat: 修改get_abstract_from_elsevier 2026-02-02 10:14:29 +08:00
caoqianming 3cf01d49e6 feat: get_abstract_from_elsevier 返回err_msg 2026-02-02 10:12:17 +08:00
caoqianming 3c84fbba49 feat: save_pdf_from_elsevier 使用instoken 2026-02-02 09:52:40 +08:00
caoqianming b621b0409d Merge branch 'main' of http://gitea.xxhhcty.xyz:8080/zcdsj/paper_server 2026-02-02 09:24:53 +08:00
caoqianming b24bb64485 feat: get_abstract_from_elsevier 使用instoken 2026-02-02 09:23:36 +08:00
caoqianming d813a53652 feat: paper list添加两个筛选条件 2026-01-31 09:53:56 +08:00
caoqianming f7d14634f8 feat: has_fulltext_pdf isf False时才去save 2026-01-31 09:51:52 +08:00
caoqianming e2687874eb feat: get_abstract_from_elsevier 返回抓取信息 2026-01-30 14:09:09 +08:00
caoqianming 16388682b9 feat: release_working_paper2 2026-01-30 14:01:03 +08:00