YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
MC-BERT is a novel conceptualized representation learning approach for the medical domain. First, we use a different mask generation procedure to mask spans of tokens, rather than only random ones. We also introduce two kinds of masking strategies, namely whole entity masking and whole span masking. Finally, MC-BERT split the input document into segments based on the actual "sentences" provided by the user as positive samples and sample random sentences from other documents as negative samples for the next sentence prediction.
More detail: https://github.com/alibaba-research/ChineseBLUE
- Downloads last month
- 448
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support