Skip to content

add authentication to DownloadAction - #91

Merged
imay merged 2 commits into
apache:masterfrom
lingbin:master
Sep 13, 2017
Merged

imay merged 2 commits into
apache:masterfrom
lingbin:master

Conversation

@lingbin

@lingbin lingbin commented Sep 13, 2017

Copy link
Copy Markdown
Contributor
  1. use cluster_id as token;
  2. add dir limit, only files in data dir can be accessed.

1. use cluster_id as token;
2. add dir limit, only files in data dir can be accessed.
Comment thread be/src/common/config.h Outdated
CONF_Bool(disable_kudu, "false")

// to forward compatibility, will be removed later
CONF_Bool(disable_deprecated_download, "false");

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这个配置名字不好,应该直接说明你做的是什么。比如在1年后,download模型可能更新多次了,而这个配置选项看名字都不知道在干嘛了。
另外,安全功能默认应该是开启的

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

修改成enable_token_check了

Comment thread be/src/http/download_action.cpp Outdated

Status DownloadAction::check_path(const std::string& file_path) {
for (auto& allow_path : _allow_paths) {
VLOG_ROW << "allow path: " << allow_path;

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remove this debug log

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done.

Comment thread be/src/util/filesystem_util.cc Outdated
boost::filesystem::path sub(sub_path);
parent = parent.lexically_normal();
sub = sub.lexically_normal();
VLOG_ROW << "parent lexically_normal: " << parent;

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

remove debug log

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done.

Comment thread be/src/util/filesystem_util.cc Outdated
parent = parent.lexically_normal();
sub = sub.lexically_normal();
VLOG_ROW << "parent lexically_normal: " << parent;
VLOG_ROW << "sub lexically_normal: " << sub;

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

remove debug log

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done.

@imay
imay merged commit db8c40e into apache:master Sep 13, 2017
stdpain pushed a commit to stdpain/incubator-doris that referenced this pull request Jul 5, 2021
HappenLee added a commit to HappenLee/incubator-doris that referenced this pull request Jul 15, 2021
HappenLee added a commit to HappenLee/incubator-doris that referenced this pull request Sep 7, 2021
zhangstar333 added a commit to zhangstar333/incubator-doris that referenced this pull request Oct 9, 2026
Issue Number: N/A

Related PR: N/A

Problem Summary: Doris pinned lance-c at 98468344bc9d56aa7ed4a4192e844afa62b34ba1 and missed upstream apache#91 vector post-filtering and scoped FTS prefiltering. Pin the dependency to 8e9e09ecc795c91ce7f97513db94c2d91eec799d, update the archive checksum, and regenerate the local Foyer patch against the new base while keeping its implementation unchanged.

Include Lance-C vector post-filtering and scoped FTS prefiltering improvements.

- Test: Static dependency validation: shell syntax checks, archive checksum validation, strict patch application, isolated downloader idempotence and source-tree comparison. No Doris build or unit/regression tests run.
- Behavior changed: Yes; adopts upstream Lance-C apache#91 search-filter behavior.
- Does this need documentation: No
zhangstar333 added a commit to zhangstar333/incubator-doris that referenced this pull request Oct 9, 2026
Issue Number: N/A

Related PR: N/A

Problem Summary: Doris pinned lance-c at 98468344bc9d56aa7ed4a4192e844afa62b34ba1 and missed upstream apache#91 vector post-filtering and scoped FTS prefiltering. Pin the dependency to 8e9e09ecc795c91ce7f97513db94c2d91eec799d, update the archive checksum, and regenerate the local Foyer patch against the new base while keeping its implementation unchanged.

Include Lance-C vector post-filtering and scoped FTS prefiltering improvements.

- Test: Static dependency validation: shell syntax checks, archive checksum validation, strict patch application, isolated downloader idempotence and source-tree comparison. No Doris build or unit/regression tests run.
- Behavior changed: Yes; adopts upstream Lance-C apache#91 search-filter behavior.
- Does this need documentation: No
zhangstar333 added a commit to zhangstar333/incubator-doris that referenced this pull request Oct 10, 2026
Issue Number: N/A

Related PR: N/A

Problem Summary: Doris pinned lance-c at 98468344bc9d56aa7ed4a4192e844afa62b34ba1 and missed upstream apache#91 vector post-filtering and scoped FTS prefiltering. Pin the dependency to 8e9e09ecc795c91ce7f97513db94c2d91eec799d, update the archive checksum, and regenerate the local Foyer patch against the new base while keeping its implementation unchanged.

Include Lance-C vector post-filtering and scoped FTS prefiltering improvements.

- Test: Static dependency validation: shell syntax checks, archive checksum validation, strict patch application, isolated downloader idempotence and source-tree comparison. No Doris build or unit/regression tests run.
- Behavior changed: Yes; adopts upstream Lance-C apache#91 search-filter behavior.
- Does this need documentation: No
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants