Skip to content

使用ChineseCLIPTextModel时,同样的输入获得了不同的输出tensor #387

Open

Description

@saiboft

import torch
from transformers import AutoTokenizer, ChineseCLIPTextModel

tokenizer = AutoTokenizer.from_pretrained("OFA-Sys/chinese-clip-vit-large-patch14", max_length=77)
model = ChineseCLIPTextModel.from_pretrained("OFA-Sys/chinese-clip-vit-large-patch14", torch_dtype=torch.bfloat16)
model.eval().requires_grad_(False)

inputs = tokenizer("一只猴子", truncation=True, max_length=77, return_length=False, return_overflowing_tokens=False, padding="max_length", return_tensors="pt")

outputs = model(input_ids=inputs["input_ids"], attention_mask=None, output_hidden_states=False)

print(outputs["pooler_output"])

这个脚本每次运行都会得到不同的输出,这是为什么

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions