Maksymilian commited on
Commit
bdb11fe
·
verified ·
1 Parent(s): b8db28c

Upload folder using huggingface_hub

Browse files
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ bg.png filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,102 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ datasets:
4
+ - HuggingFaceFW/fineweb-edu
5
+ - openbmb/Ultra-FineWeb
6
+ - HuggingFaceTB/finemath
7
+ - HuggingFaceTB/smollm-corpus
8
+ - openbmb/UltraData-Math
9
+ language:
10
+ - en
11
+ library_name: transformers
12
+ tags:
13
+ - causal-lm
14
+ - decoder-only
15
+ - grouped-query-attention
16
+ - rope
17
+ - swiglu
18
+ - custom-tokenizer
19
+ - curriculum-learning
20
+ - xsa
21
+ pipeline_tag: text-generation
22
+ ---
23
+
24
+ ![bg](bg.png)
25
+ # Atom 3.4m
26
+
27
+ Atom is a 3.4M parameter causal language model developed by **Universal Computing Research**. It was pretrained from scratch as a compact research model for studying language-model architecture, data curricula, and small-model benchmarking.
28
+
29
+ ## Model details
30
+
31
+ - Architecture: causal decoder-only language model
32
+ - Parameters: 3,412,800
33
+ - Layers: 7
34
+ - Hidden size: 192
35
+ - Attention: 3 query heads and 1 key-value head (grouped-query attention)
36
+ - Head dimension: 64
37
+ - Feed-forward size: 480
38
+ - Context length: 512 tokens
39
+ - Positional encoding: rotary position embeddings (RoPE)
40
+ - RoPE Theta = 5000.0
41
+ - Normalization: RMSNorm
42
+ - Activation: gated SiLU feed-forward network
43
+ - Vocabulary size: 4,096 tokens
44
+ - Tokenizer: custom byte-level BPE, exposed as `GPT2TokenizerFast`
45
+ - Training tokens: approximately 5 billion
46
+ - License: Apache-2.0
47
+
48
+ The model uses tied input and output embeddings. Its custom attention implementation combines grouped-query attention with XSE.
49
+
50
+ ## Tokenizer
51
+
52
+ Atom uses a custom byte-level BPE tokenizer trained specifically for this pretraining corpus. The tokenizer has a vocabulary of 4,096 tokens and includes dedicated padding, beginning-of-sequence, end-of-sequence, unknown, and end-of-text tokens.
53
+
54
+ ## Training data and curriculum
55
+
56
+ Atom was trained on a curriculum combining general web text, educational material, synthetic textbook-style content, and mathematical data. The mixture changed gradually during training: general web data was emphasized earlier, while educational, synthetic, and mathematical material received more weight later.
57
+
58
+ Approximate proportions over the complete training run were:
59
+
60
+ | Dataset | Subset / split used | Approximate proportion |
61
+ |---|---|---:|
62
+ | [HuggingFaceFW/fineweb-edu](https://huggingface.co/datasets/HuggingFaceFW/fineweb-edu) | All available `CC-MAIN-*` configurations under `data/`, `train` split | 39% |
63
+ | [openbmb/Ultra-FineWeb](https://huggingface.co/datasets/openbmb/Ultra-FineWeb) | English v1.4 (`ultrafineweb_en_v1_4`; `en` split) | 31% |
64
+ | [HuggingFaceTB/finemath](https://huggingface.co/datasets/HuggingFaceTB/finemath) | `finemath-3plus`, `train` split | 12% |
65
+ | [HuggingFaceTB/smollm-corpus](https://huggingface.co/datasets/HuggingFaceTB/smollm-corpus) | `cosmopedia-v2`, `train` split | 12% |
66
+ | [openbmb/UltraData-Math](https://huggingface.co/datasets/openbmb/UltraData-Math) | `UltraData-Math-L2-preview`, `train` split | 6% |
67
+
68
+ These percentages describe the approximate aggregate sampling mixture rather than exact document counts. Refer to the individual dataset cards for their source information, licenses, and usage conditions.
69
+
70
+ ## Intended use
71
+
72
+ This is a small base language model intended for research and benchmarking. It may be useful for experiments involving compact architectures, pretraining curricula, tokenization, evaluation pipelines, and resource-constrained inference.
73
+
74
+ Atom is a base model and has not been instruction-tuned or aligned for assistant-style interaction.
75
+
76
+ ## Evaluation
77
+
78
+ Atom was evaluated with EleutherAI's `lm-evaluation-harness` and ArithMark-2.0.
79
+
80
+ ### lm-evaluation-harness
81
+
82
+ | Task | Metric | Score |
83
+ |---|---|---:|
84
+ | ARC-Easy | `acc_norm` | 33.08% |
85
+ | ARC-Challenge | `acc_norm` | 21.76% |
86
+ | HellaSwag | `acc_norm` | 27.65% |
87
+ | PIQA | `acc_norm` | 55.71% |
88
+
89
+ ### ArithMark-2.0
90
+
91
+ | Benchmark | Metric | Score |
92
+ |---|---|---:|
93
+ | ArithMark-2.0 | `acc` | 27.36% |
94
+
95
+ **Average score: 34.54%**
96
+
97
+
98
+ ## Limitations
99
+
100
+ Atom is a very small model and should not be expected to produce reliable factual, safety-critical, or instruction-following outputs. Its short context window and limited capacity constrain coherence, knowledge recall, reasoning, and long-form generation.
101
+
102
+ The model may reproduce errors, biases, or undesirable patterns present in its training data. It has not undergone dedicated safety training and should not be used for high-stakes decisions.
bg.png ADDED

Git LFS Details

  • SHA256: a2efd0dac958847f4af37fc5d0ddd844407d718389a35e36047dbb541098db63
  • Pointer size: 132 Bytes
  • Size of remote file: 2.42 MB
config.json ADDED
@@ -0,0 +1,25 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "GPTForCausalLM"
4
+ ],
5
+ "auto_map": {
6
+ "AutoConfig": "config.GPTConfig",
7
+ "AutoModelForCausalLM": "model.GPTForCausalLM"
8
+ },
9
+ "block_size": 512,
10
+ "dtype": "float32",
11
+ "head_dim": 64,
12
+ "hidden_size": 192,
13
+ "intermediate_size": 480,
14
+ "labels_are_shifted": true,
15
+ "max_position_embeddings": 512,
16
+ "model_type": "gpt",
17
+ "num_attention_heads": 3,
18
+ "num_hidden_layers": 7,
19
+ "num_key_value_heads": 1,
20
+ "rms_norm_eps": 1e-06,
21
+ "rope_theta": 5000.0,
22
+ "transformers_version": "4.57.6",
23
+ "vocab_size": 4096,
24
+ "xsa_projection": true
25
+ }
config.py ADDED
@@ -0,0 +1,207 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ """Environment-driven training configuration."""
2
+
3
+ from __future__ import annotations
4
+
5
+ import os
6
+ import math
7
+ import uuid
8
+ from dataclasses import dataclass, field
9
+ from pathlib import Path
10
+
11
+ from transformers import PretrainedConfig
12
+
13
+
14
+ DEFAULT_VOCAB_SIZE = 4096
15
+ DEFAULT_HIDDEN_SIZE = 192
16
+ DEFAULT_NUM_HIDDEN_LAYERS = 7
17
+ DEFAULT_NUM_ATTENTION_HEADS = 3
18
+ DEFAULT_NUM_KEY_VALUE_HEADS = 1
19
+ DEFAULT_HEAD_DIM = DEFAULT_HIDDEN_SIZE // DEFAULT_NUM_ATTENTION_HEADS
20
+ DEFAULT_INTERMEDIATE_SIZE = DEFAULT_HIDDEN_SIZE * 5 // 2
21
+ DEFAULT_BLOCK_SIZE = 512
22
+ DEFAULT_ROPE_THETA = 5000.0
23
+
24
+
25
+ class GPTConfig(PretrainedConfig):
26
+ model_type = "gpt"
27
+
28
+ def __init__(
29
+ self,
30
+ vocab_size: int = DEFAULT_VOCAB_SIZE,
31
+ hidden_size: int = DEFAULT_HIDDEN_SIZE,
32
+ num_hidden_layers: int = DEFAULT_NUM_HIDDEN_LAYERS,
33
+ num_attention_heads: int = DEFAULT_NUM_ATTENTION_HEADS,
34
+ num_key_value_heads: int | None = DEFAULT_NUM_KEY_VALUE_HEADS,
35
+ intermediate_size: int | None = DEFAULT_INTERMEDIATE_SIZE,
36
+ head_dim: int | None = None,
37
+ block_size: int = DEFAULT_BLOCK_SIZE,
38
+ rope_theta: float = DEFAULT_ROPE_THETA,
39
+ rms_norm_eps: float = 1e-6,
40
+ xsa_projection: bool = True,
41
+ tie_word_embeddings: bool = True,
42
+ labels_are_shifted: bool = False,
43
+ **kwargs,
44
+ ):
45
+ if num_key_value_heads is None:
46
+ num_key_value_heads = num_attention_heads
47
+ if head_dim is None:
48
+ if hidden_size % num_attention_heads != 0:
49
+ raise ValueError("hidden_size must be divisible by num_attention_heads")
50
+ head_dim = hidden_size // num_attention_heads
51
+ if intermediate_size is None:
52
+ intermediate_size = hidden_size * 4
53
+ if num_attention_heads % num_key_value_heads != 0:
54
+ raise ValueError("num_attention_heads must be divisible by num_key_value_heads")
55
+ if head_dim % 2 != 0:
56
+ raise ValueError("head_dim must be even for RoPE")
57
+
58
+ super().__init__(tie_word_embeddings=tie_word_embeddings, **kwargs)
59
+ self.vocab_size = int(vocab_size)
60
+ self.hidden_size = int(hidden_size)
61
+ self.num_hidden_layers = int(num_hidden_layers)
62
+ self.num_attention_heads = int(num_attention_heads)
63
+ self.num_key_value_heads = int(num_key_value_heads)
64
+ self.intermediate_size = int(intermediate_size)
65
+ self.head_dim = int(head_dim)
66
+ self.block_size = int(block_size)
67
+ self.max_position_embeddings = int(block_size)
68
+ self.rope_theta = float(rope_theta)
69
+ self.rms_norm_eps = float(rms_norm_eps)
70
+ self.xsa_projection = bool(xsa_projection)
71
+ self.labels_are_shifted = bool(labels_are_shifted)
72
+
73
+
74
+ def _bool_env(name: str, default: bool) -> bool:
75
+ raw = os.environ.get(name)
76
+ if raw is None:
77
+ return default
78
+ return raw.strip().lower() in {"1", "true", "yes", "on"}
79
+
80
+
81
+ def _path_env(name: str, default: str) -> str:
82
+ return str(Path(os.environ.get(name, default)).expanduser())
83
+
84
+
85
+ @dataclass
86
+ class Hyperparameters:
87
+ data_dir: str = field(default_factory=lambda: _path_env("DATA_DIR", "."))
88
+ tokenized_dir: str = field(default_factory=lambda: _path_env("TOKENIZED_DIR", "tokenized"))
89
+ tokenizer_dir: str = field(default_factory=lambda: _path_env("TOKENIZER_DIR", "tokenizer_4k"))
90
+ tokenizer_path: str = field(default_factory=lambda: os.environ.get("TOKENIZER_PATH", ""))
91
+ curriculum_path: str = field(default_factory=lambda: os.environ.get("CURRICULUM_PATH", ""))
92
+ mix_weights_path: str = field(default_factory=lambda: os.environ.get("MIX_WEIGHTS_PATH", ""))
93
+ run_id: str = field(default_factory=lambda: os.environ.get("RUN_ID", str(uuid.uuid4())))
94
+ seed: int = field(default_factory=lambda: int(os.environ.get("SEED", "1337")))
95
+ rank: int = field(init=False)
96
+
97
+ iterations: int = field(default_factory=lambda: int(os.environ.get("ITERATIONS", "10000")))
98
+ requested_train_tokens: int = field(init=False)
99
+ train_tokens: int = field(init=False)
100
+ decay_start_frac: float = field(default_factory=lambda: float(os.environ.get("DECAY_START_FRAC", "0.7")))
101
+ warmup_steps: int = field(default_factory=lambda: int(os.environ.get("WARMUP_STEPS", "0")))
102
+ lr_warmup_steps: int = field(default_factory=lambda: int(os.environ.get("LR_WARMUP_STEPS", "500")))
103
+ train_batch_tokens: int = field(default_factory=lambda: int(os.environ.get("TRAIN_BATCH_TOKENS", str(DEFAULT_BLOCK_SIZE * 512))))
104
+ train_seq_len: int = field(init=False)
105
+ eval_seq_len: int = field(init=False)
106
+ grad_accum_steps: int = field(default_factory=lambda: int(os.environ.get("GRAD_ACCUM_STEPS", "2")))
107
+ train_log_every: int = field(default_factory=lambda: int(os.environ.get("TRAIN_LOG_EVERY", "100")))
108
+ train_log_first_steps: int = field(default_factory=lambda: int(os.environ.get("TRAIN_LOG_FIRST_STEPS", "500")))
109
+
110
+ val_batch_tokens: int = field(default_factory=lambda: int(os.environ.get("VAL_BATCH_TOKENS", str(DEFAULT_BLOCK_SIZE * 256))))
111
+ val_loss_every: int = field(default_factory=lambda: int(os.environ.get("VAL_LOSS_EVERY", "1000")))
112
+ val_max_tokens: int = field(default_factory=lambda: int(os.environ.get("VAL_MAX_TOKENS", "10_000_000")))
113
+
114
+ vocab_size: int = field(default_factory=lambda: int(os.environ.get("VOCAB_SIZE", str(DEFAULT_VOCAB_SIZE))))
115
+ hidden_size: int = field(default_factory=lambda: int(os.environ.get("HIDDEN_SIZE", os.environ.get("MODEL_DIM", str(DEFAULT_HIDDEN_SIZE)))))
116
+ num_hidden_layers: int = field(default_factory=lambda: int(os.environ.get("NUM_HIDDEN_LAYERS", os.environ.get("NUM_LAYERS", str(DEFAULT_NUM_HIDDEN_LAYERS)))))
117
+ num_attention_heads: int = field(default_factory=lambda: int(os.environ.get("NUM_ATTENTION_HEADS", os.environ.get("NUM_HEADS", str(DEFAULT_NUM_ATTENTION_HEADS)))))
118
+ num_key_value_heads: int = field(default_factory=lambda: int(os.environ.get("NUM_KEY_VALUE_HEADS", os.environ.get("NUM_KV_HEADS", str(DEFAULT_NUM_KEY_VALUE_HEADS)))))
119
+ head_dim: int = field(init=False)
120
+ intermediate_size: int = field(default_factory=lambda: int(os.environ.get("INTERMEDIATE_SIZE", os.environ.get("INTERMEDIATE", str(DEFAULT_INTERMEDIATE_SIZE)))))
121
+ block_size: int = field(default_factory=lambda: int(os.environ.get("BLOCK_SIZE", str(DEFAULT_BLOCK_SIZE))))
122
+ rope_theta: float = field(default_factory=lambda: float(os.environ.get("ROPE_THETA", os.environ.get("ROPE_BASE", str(DEFAULT_ROPE_THETA)))))
123
+ rms_norm_eps: float = field(default_factory=lambda: float(os.environ.get("RMS_NORM_EPS", "1e-6")))
124
+ xsa_projection: bool = field(default_factory=lambda: _bool_env("XSA_PROJECTION", True))
125
+ tie_word_embeddings: bool = field(default_factory=lambda: _bool_env("TIE_WORD_EMBEDDINGS", _bool_env("TIE_EMBEDDINGS", True)))
126
+
127
+ min_lr: float = field(default_factory=lambda: float(os.environ.get("MIN_LR", "0.0")))
128
+ lr: float = field(default_factory=lambda: float(os.environ.get("LR", "0.004")))
129
+ beta1: float = field(default_factory=lambda: float(os.environ.get("BETA1", "0.9")))
130
+ beta2: float = field(default_factory=lambda: float(os.environ.get("BETA2", "0.95")))
131
+ adam_eps: float = field(default_factory=lambda: float(os.environ.get("ADAM_EPS", "1e-8")))
132
+ weight_decay: float = field(default_factory=lambda: float(os.environ.get("WEIGHT_DECAY", "0.005")))
133
+
134
+ compile_model: bool = field(default_factory=lambda: _bool_env("COMPILE_MODEL", True))
135
+ autocast: bool = field(default_factory=lambda: _bool_env("AUTOCAST", True))
136
+ bf16: bool = field(default_factory=lambda: _bool_env("BF16", True))
137
+ device: str = field(default_factory=lambda: os.environ.get("DEVICE", "auto"))
138
+
139
+ output_dir: str = field(default_factory=lambda: _path_env("OUTPUT_DIR", "outputs"))
140
+ checkpoint_name: str = field(default_factory=lambda: os.environ.get("CHECKPOINT_NAME", "final_model"))
141
+ logfile: str = field(init=False)
142
+ model_path: str = field(init=False)
143
+ is_main_process: bool = True
144
+ train_files: str = field(init=False)
145
+ val_files: str = field(init=False)
146
+
147
+ def __post_init__(self) -> None:
148
+ self.rank = int(os.environ.get("RANK", "0"))
149
+ if self.rank < 0:
150
+ raise ValueError("RANK must be non-negative")
151
+ self.is_main_process = self.rank == 0
152
+ self.head_dim = int(os.environ.get("HEAD_DIM", str(self.hidden_size // self.num_attention_heads)))
153
+ self.train_seq_len = int(os.environ.get("TRAIN_SEQ_LEN", str(self.block_size)))
154
+ self.eval_seq_len = int(os.environ.get("EVAL_SEQ_LEN", os.environ.get("TRAIN_SEQ_LEN", str(self.train_seq_len))))
155
+ token_alignment = self.train_seq_len * self.grad_accum_steps
156
+ if self.train_batch_tokens % token_alignment != 0:
157
+ raise ValueError(
158
+ "TRAIN_BATCH_TOKENS must be divisible by TRAIN_SEQ_LEN * GRAD_ACCUM_STEPS"
159
+ )
160
+ requested_train_tokens = int(os.environ.get("TRAIN_TOKENS", "0"))
161
+ self.requested_train_tokens = requested_train_tokens or self.iterations * self.train_batch_tokens
162
+ if self.requested_train_tokens <= 0:
163
+ raise ValueError("TRAIN_TOKENS must be positive")
164
+ self.train_tokens = self.requested_train_tokens - (self.requested_train_tokens % token_alignment)
165
+ if self.train_tokens <= 0:
166
+ raise ValueError(
167
+ "TRAIN_TOKENS must provide at least TRAIN_SEQ_LEN * GRAD_ACCUM_STEPS tokens"
168
+ )
169
+ self.iterations = math.ceil(self.train_tokens / self.train_batch_tokens)
170
+ tokenized = Path(self.tokenized_dir)
171
+ self.train_files = os.environ.get("TRAIN_FILES", str(tokenized / "*" / "shard_*.bin"))
172
+ self.val_files = os.environ.get("VAL_FILES", os.environ.get("TRAIN_FILES", self.train_files))
173
+ explicit_legacy_mix = bool(os.environ.get("MIX_WEIGHTS_PATH"))
174
+ if not self.curriculum_path and not explicit_legacy_mix:
175
+ tokenized_curriculum = tokenized / "curriculum.json"
176
+ default_curriculum = Path("pretraining_curriculum.json")
177
+ if tokenized_curriculum.exists():
178
+ self.curriculum_path = str(tokenized_curriculum)
179
+ elif default_curriculum.exists():
180
+ self.curriculum_path = str(default_curriculum)
181
+ if not self.mix_weights_path and not self.curriculum_path:
182
+ mix_weights_path = tokenized / "mix_weights.json"
183
+ self.mix_weights_path = str(mix_weights_path) if mix_weights_path.exists() else ""
184
+ if not self.tokenizer_path:
185
+ tok_dir = Path(self.tokenizer_dir)
186
+ json_path = tok_dir / "tokenizer.json"
187
+ self.tokenizer_path = str(json_path if json_path.exists() else tok_dir)
188
+ out = Path(self.output_dir)
189
+ self.logfile = os.environ.get("LOGFILE", str(out / "logs" / f"{self.run_id}.txt"))
190
+ self.model_path = os.environ.get("MODEL_PATH", str(out / self.checkpoint_name))
191
+
192
+ def to_model_config(self) -> GPTConfig:
193
+ return GPTConfig(
194
+ vocab_size=self.vocab_size,
195
+ hidden_size=self.hidden_size,
196
+ num_hidden_layers=self.num_hidden_layers,
197
+ num_attention_heads=self.num_attention_heads,
198
+ num_key_value_heads=self.num_key_value_heads,
199
+ head_dim=self.head_dim,
200
+ intermediate_size=self.intermediate_size,
201
+ block_size=self.block_size,
202
+ rope_theta=self.rope_theta,
203
+ rms_norm_eps=self.rms_norm_eps,
204
+ xsa_projection=self.xsa_projection,
205
+ tie_word_embeddings=self.tie_word_embeddings,
206
+ labels_are_shifted=True,
207
+ )
configuration_gpt.py ADDED
@@ -0,0 +1,27 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ from .config import (
3
+ DEFAULT_BLOCK_SIZE,
4
+ DEFAULT_HEAD_DIM,
5
+ DEFAULT_HIDDEN_SIZE,
6
+ DEFAULT_INTERMEDIATE_SIZE,
7
+ DEFAULT_NUM_ATTENTION_HEADS,
8
+ DEFAULT_NUM_HIDDEN_LAYERS,
9
+ DEFAULT_NUM_KEY_VALUE_HEADS,
10
+ DEFAULT_ROPE_THETA,
11
+ DEFAULT_VOCAB_SIZE,
12
+ GPTConfig,
13
+ )
14
+
15
+
16
+ __all__ = [
17
+ "DEFAULT_BLOCK_SIZE",
18
+ "DEFAULT_HEAD_DIM",
19
+ "DEFAULT_HIDDEN_SIZE",
20
+ "DEFAULT_INTERMEDIATE_SIZE",
21
+ "DEFAULT_NUM_ATTENTION_HEADS",
22
+ "DEFAULT_NUM_HIDDEN_LAYERS",
23
+ "DEFAULT_NUM_KEY_VALUE_HEADS",
24
+ "DEFAULT_ROPE_THETA",
25
+ "DEFAULT_VOCAB_SIZE",
26
+ "GPTConfig",
27
+ ]
generation_config.json ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "transformers_version": "4.57.6"
4
+ }
merges.txt ADDED
@@ -0,0 +1,3836 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ #version: 0.2
2
+ Ġ t
3
+ Ġ a
4
+ i n
5
+ h e
6
+ r e
7
+ o n
8
+ Ġt he
9
+ a t
10
+ e r
11
+ Ġ s
12
+ Ġ o
13
+ Ġ c
14
+ e n
15
+ e s
16
+ i s
17
+ a l
18
+ i t
19
+ o r
20
+ n d
21
+ Ġ w
22
+ Ġ p
23
+ in g
24
+ Ġ Ġ
25
+ Ġ f
26
+ a n
27
+ i on
28
+ Ġ b
29
+ Ġo f
30
+ e d
31
+ o u
32
+ Ġ m
33
+ Ġ in
34
+ a r
35
+ i c
36
+ Ġ d
37
+ Ġa nd
38
+ l e
39
+ Ġt o
40
+ r o
41
+ c t
42
+ 0 0
43
+ Ġ e
44
+ en t
45
+ Ġt h
46
+ s t
47
+ o m
48
+ Ġ re
49
+ v e
50
+ Ġ h
51
+ a s
52
+ Ġ n
53
+ e t
54
+ Ġ is
55
+ Ġ l
56
+ i l
57
+ ĠĠ ĠĠ
58
+ at ion
59
+ i m
60
+ l y
61
+ r a
62
+ Ġ T
63
+ o l
64
+ c e
65
+ Ġ g
66
+ u t
67
+ o w
68
+ i g
69
+ â Ģ
70
+ s e
71
+ o t
72
+ Ġ u
73
+ i d
74
+ Ġf or
75
+ u l
76
+ Ġb e
77
+ Ġ y
78
+ Ġ 1
79
+ c h
80
+ Ġ A
81
+ Ġ (
82
+ Ġ I
83
+ u r
84
+ Ġ S
85
+ Ġs t
86
+ v er
87
+ Ġ on
88
+ Ġth at
89
+ a m
90
+ Ġc on
91
+ Ġ C
92
+ i f
93
+ 00 0
94
+ it h
95
+ Ġy ou
96
+ e l
97
+ u m
98
+ Ġp ro
99
+ q u
100
+ i r
101
+ Ġ 2
102
+ Ġa n
103
+ a y
104
+ Ġa s
105
+ Ġw ith
106
+ o d
107
+ at e
108
+ Ġ it
109
+ Ġa re
110
+ g e
111
+ Ġe x
112
+ Ġ v
113
+ Ġa l
114
+ Ġ P
115
+ Ġo r
116
+ a b
117
+ t er
118
+ he r
119
+ Ġ M
120
+ e ct
121
+ a d
122
+ re s
123
+ Â ł
124
+ Ġ =
125
+ Ġw h
126
+ ĠT he
127
+ er s
128
+ is t
129
+ it y
130
+ Ġc om
131
+ m ent
132
+ es s
133
+ i v
134
+ i ve
135
+ Ġd e
136
+ ĠĠĠĠ ĠĠĠĠ
137
+ â Ķ
138
+ i es
139
+ Ġw e
140
+ p l
141
+ t h
142
+ t e
143
+ ig h
144
+ o s
145
+ es t
146
+ Ġc an
147
+ o re
148
+ Ġ B
149
+ Ġs u
150
+ u s
151
+ Ġ F
152
+ Ġ r
153
+ il l
154
+ i al
155
+ k e
156
+ Ġ E
157
+ u n
158
+ o p
159
+ en d
160
+ - -
161
+ Ġb y
162
+ a c
163
+ a in
164
+ Ġ D
165
+ e m
166
+ an t
167
+ Ġ he
168
+ n t
169
+ u re
170
+ a nd
171
+ Ġ W
172
+ Ġ R
173
+ âĶ Ģ
174
+ p p
175
+ r i
176
+ ro m
177
+ ion s
178
+ ic al
179
+ âĶĢ âĶĢ
180
+ Ġ H
181
+ igh t
182
+ Ġa t
183
+ o c
184
+ Ġc h
185
+ l d
186
+ Ġs e
187
+ Ġth is
188
+ Ġn e
189
+ Ġh a
190
+ Ġ le
191
+ in e
192
+ âĢ Ļ
193
+ u d
194
+ or t
195
+ Ġ \
196
+ ar t
197
+ Ġ L
198
+ Ġf rom
199
+ Ġ 0
200
+ p er
201
+ p t
202
+ Ġs h
203
+ Ġu s
204
+ o g
205
+ Ġ âĢ
206
+ p e
207
+ Ġ N
208
+ p le
209
+ i z
210
+ . .
211
+ al l
212
+ Ġ 3
213
+ a ct
214
+ # #
215
+ a g
216
+ Ġn ot
217
+ ation s
218
+ Ġ en
219
+ r ou
220
+ ul t
221
+ Ġha ve
222
+ d u
223
+ Ġ im
224
+ e re
225
+ Ġa b
226
+ Ġ G
227
+ ct ion
228
+ Ġ -
229
+ a ge
230
+ Ġyou r
231
+ f f
232
+ Ġ k
233
+ Ġ $
234
+ a re
235
+ ou r
236
+ or m
237
+ om e
238
+ ou t
239
+ o st
240
+ Ġw or
241
+ Ġw he
242
+ ic h
243
+ Ġ O
244
+ Ġre s
245
+ u st
246
+ ou ld
247
+ x t
248
+ ar d
249
+ at ed
250
+ Ġp l
251
+ an ce
252
+ l ow
253
+ T he
254
+ u e
255
+ ab le
256
+ g h
257
+ an s
258
+ id e
259
+ t her
260
+ Ġa d
261
+ b er
262
+ b le
263
+ ĠT h
264
+ Ġm e
265
+ ĠĠ Ġ
266
+ a st
267
+ in d
268
+ ou s
269
+ Ġin t
270
+ a ch
271
+ ĠI n
272
+ a k
273
+ in t
274
+ Ġ +
275
+ ig n
276
+ Ġw ill
277
+ Ġin c
278
+ el l
279
+ a p
280
+ Ġcon t
281
+ Ġ 4
282
+ Ġthe ir
283
+ Ġcom p
284
+ ' s
285
+ k s
286
+ c c
287
+ Ġd o
288
+ Ġwh ich
289
+ Ġt r
290
+ ve l
291
+ ent s
292
+ en ce
293
+ u al
294
+ i p
295
+ i e
296
+ im e
297
+ Ġu n
298
+ e p
299
+ res s
300
+ Ġ U
301
+ Ġw as
302
+ ar y
303
+ Ġd is
304
+ o f
305
+ Ġp er
306
+ on g
307
+ it ion
308
+ i re
309
+ as s
310
+ Ġn um
311
+ as e
312
+ ĠĠĠĠĠĠĠĠ ĠĠĠĠĠĠĠĠ
313
+ Ġc l
314
+ Ġ qu
315
+ r u
316
+ at h
317
+ -- --
318
+ Ġ j
319
+ if f
320
+ Âł Âł
321
+ Ġthe y
322
+ Ġ 5
323
+ 0 1
324
+ an g
325
+ Ġm ore
326
+ en s
327
+ Ġon e
328
+ or s
329
+ c es
330
+ e ar
331
+ f orm
332
+ Ġal l
333
+ Ġh as
334
+ Ġ x
335
+ Ġs p
336
+ ) .
337
+ a ce
338
+ Ġa r
339
+ âĶĢâĶĢ âĶĢâĶĢ
340
+ Ġl i
341
+ o o
342
+ p h
343
+ Ġ J
344
+ r ic
345
+ s o
346
+ Ġo ut
347
+ te xt
348
+ Ġp re
349
+ Ġt e
350
+ at er
351
+ ar i
352
+ Ġim p
353
+ Ġs y
354
+ Ġo ther
355
+ Ġb ut
356
+ at ing
357
+ Ġ "
358
+ it e
359
+ _ _
360
+ Ġm an
361
+ a ke
362
+ Ġ if
363
+ am e
364
+ Ġd iff
365
+ nd er
366
+ Ġe qu
367
+ o od
368
+ Ġv al
369
+ on e
370
+ Ġp o
371
+ Ġab out
372
+ i le
373
+ Ġe v
374
+ a v
375
+ Ġs c
376
+ m s
377
+ Ġa pp
378
+ Ġp art
379
+ Ġb et
380
+ ) ,
381
+ n ow
382
+ Ġh ow
383
+ Ġ ro
384
+ ver y
385
+ on d
386
+ ou nd
387
+ ic e
388
+ Ġs o
389
+ ac k
390
+ ĠTh is
391
+ r y
392
+ re e
393
+ ` `
394
+ Ġal so
395
+ u b
396
+ ic s
397
+ Ġ V
398
+ Ġint o
399
+ o se
400
+ Ġthe se
401
+ Ġt w
402
+ l es
403
+ Ġt ime
404
+ a u
405
+ w e
406
+ at ive
407
+ y s
408
+ ra c
409
+ if ic
410
+ Ġli ke
411
+ or y
412
+ Ġs pe
413
+ or d
414
+ le ct
415
+ Ġ 6
416
+ at es
417
+ Ġu se
418
+ Ġthe re
419
+ j ect
420
+ ou nt
421
+ Ġu p
422
+ Ġwhe n
423
+ Ġ â
424
+ Ġf un
425
+ et h
426
+ Ġm od
427
+ ut ion
428
+ i a
429
+ at a
430
+ st em
431
+ { \
432
+ Ġs ome
433
+ Ġdiff ere
434
+ Ġin ter
435
+ Ġit s
436
+ âĢ Ŀ
437
+ Ġ K
438
+ Ġ .
439
+ Ġcom m
440
+ Ġthe m
441
+ il ity
442
+ Ġst ud
443
+ Ġs ol
444
+ Ġu nder
445
+ l l
446
+ it ies
447
+ Ġ [
448
+ Ġ Y
449
+ ment s
450
+ ĠS t
451
+ Ġth an
452
+ a il
453
+ k ing
454
+ rou gh
455
+ Ġtw o
456
+ Ġcon s
457
+ ĠI t
458
+ ay s
459
+ ri b
460
+ c ul
461
+ il d
462
+ n e
463
+ Ġe m
464
+ al ly
465
+ c ess
466
+ Ġbe c
467
+ Ġex p
468
+ f t
469
+ Ġf e
470
+ Ġk now
471
+ ver s
472
+ ol og
473
+ ra ct
474
+ o ve
475
+ | >
476
+ âĢ ¢
477
+ on s
478
+ Ġin d
479
+ < |
480
+ end of
481
+ endof text
482
+ ing s
483
+ Ġre l
484
+ Ġc ol
485
+ Ġo b
486
+ Ġo ur
487
+ ra d
488
+ Ġfor m
489
+ am ple
490
+ Ġne ed
491
+ Ġnum ber
492
+ Ġan y
493
+ Ġo ver
494
+ Ġsu ch
495
+ Ġd es
496
+ Ġv ari
497
+ ir st
498
+ Ġp os
499
+ i b
500
+ Ġhe l
501
+ Ġm ay
502
+ Ġa cc
503
+ n ing
504
+ Ġe ff
505
+ i ent
506
+ Ġc o
507
+ Ġwh at
508
+ we en
509
+ I n
510
+ Ġa m
511
+ 1 0
512
+ Ġhel p
513
+ Ġs im
514
+ ĠâĢ ľ
515
+ Ġre c
516
+ Ġas s
517
+ Ġc re
518
+ Ġa ct
519
+ an ge
520
+ ĠâĢ ĵ
521
+ Ġbet ween
522
+ it s
523
+ Ġg en
524
+ Ġsy stem
525
+ Ġ1 0
526
+ l ud
527
+ er m
528
+ ro w
529
+ r it
530
+ Ġg o
531
+ n s
532
+ er v
533
+ Ġ 7
534
+ Ġthe n
535
+ ul ar
536
+ _ {
537
+ Ġe ach
538
+ u res
539
+ Ġp e
540
+ Ġw ould
541
+ ou gh
542
+ Ġad d
543
+ Ġus ed
544
+ o v
545
+ e f
546
+ u es
547
+ is e
548
+ ot h
549
+ ra m
550
+ * *
551
+ h at
552
+ o b
553
+ au se
554
+ ow er
555
+ $ $
556
+ Ġa g
557
+ Ġd ata
558
+ Ġth rough
559
+ Ġwhe re
560
+ Ġus ing
561
+ t ain
562
+ Ġpro v
563
+ Ġtr ans
564
+ Ġpo int
565
+ Ġ 8
566
+ Ġsu b
567
+ Ġwe re
568
+ al s
569
+ Ġre p
570
+ c ed
571
+ ol low
572
+ ĠC h
573
+ f ul
574
+ Ġ2 01
575
+ Ġs et
576
+ Ġre g
577
+ Ġde c
578
+ Ġdiffere nt
579
+ Ġwh o
580
+ Ġd ist
581
+ Ġin v
582
+ ur ing
583
+ Ġm at
584
+ e c
585
+ re d
586
+ i ble
587
+ is h
588
+ Ġp r
589
+ Ġg et
590
+ a x
591
+ Ġwor k
592
+ Ġpro du
593
+ Ġspe c
594
+ Ġon ly
595
+ Ġp h
596
+ Ġn o
597
+ Ġin te
598
+ Ġa c
599
+ as ed
600
+ iz e
601
+ al cul
602
+ Ġne w
603
+ rou nd
604
+ Ġf irst
605
+ Ġ 9
606
+ oo k
607
+ er g
608
+ Ġfun ction
609
+ Ġs ign
610
+ Ġd i
611
+ Ġb l
612
+ ent ial
613
+ st and
614
+ re at
615
+ t ing
616
+ } }
617
+ Ġf ollow
618
+ s s
619
+ Ġinc lud
620
+ al th
621
+ i an
622
+ Ġres ult
623
+ 1 2
624
+ Ġ1 9
625
+ Ġsh ow
626
+ ch n
627
+ pl ic
628
+ Ġpro ble
629
+ op le
630
+ vel op
631
+ t he
632
+ Ġ |
633
+ ation al
634
+ ic t
635
+ p ut
636
+ Ġd et
637
+ en g
638
+ Ġre m
639
+ en c
640
+ Ġdis c
641
+ he s
642
+ n g
643
+ ar k
644
+ Ġf ind
645
+ res ent
646
+ Ġy ear
647
+ ---- ----
648
+ iv en
649
+ Ġin st
650
+ Ġ {
651
+ Ġde f
652
+ ĠP ro
653
+ t en
654
+ f rac
655
+ Ġs m
656
+ ic k
657
+ Ġc ur
658
+ ol d
659
+ Ġf l
660
+ eth od
661
+ ce pt
662
+ n ce
663
+ Ġs ur
664
+ Ġof f
665
+ p ect
666
+ .. .
667
+ ra in
668
+ ru ct
669
+ Ġle ar
670
+ ĠI f
671
+ i ed
672
+ Ġex per
673
+ Ġin f
674
+ Ġbe en
675
+ p s
676
+ Ġt y
677
+ Ġman y
678
+ Ġf act
679
+ ĠF or
680
+ Ġc or
681
+ Ġgen er
682
+ u c
683
+ 1 1
684
+ Ġj ust
685
+ ie w
686
+ i ous
687
+ ## #
688
+ Ġpe ople
689
+ Ġval ue
690
+ } {
691
+ 2 0
692
+ f ore
693
+ im es
694
+ he m
695
+ ^ {
696
+ Ġ &
697
+ Ġex pl
698
+ in k
699
+ ĠW e
700
+ iv es
701
+ f ter
702
+ Ġm ost
703
+ Ġcom ple
704
+ Ġs a
705
+ Ġsh ould
706
+ Ġ i
707
+ T h
708
+ g et
709
+ ĠH ow
710
+ ' t
711
+ he d
712
+ on t
713
+ Ġs ame
714
+ at ure
715
+ Ġse c
716
+ ra ph
717
+ ak ing
718
+ he n
719
+ in es
720
+ ical ly
721
+ Ġde velop
722
+ Ġapp ro
723
+ e ver
724
+ Ġst r
725
+ r ight
726
+ Ġe very
727
+ Ġm y
728
+ Ġ ra
729
+ ab ility
730
+ Ġpro cess
731
+ âĶĢâĶĢâĶĢâĶĢ âĶĢâĶĢâĶĢâĶĢ
732
+ Ġmod el
733
+ Ġse e
734
+ Ġre f
735
+ Ġâ Ī
736
+ ĠR e
737
+ b ers
738
+ i ence
739
+ se l
740
+ Ġ2 0
741
+ Ġh is
742
+ __ __
743
+ ur al
744
+ Ġeff ect
745
+ ĠE x
746
+ Ġc ould
747
+ Ġm ake
748
+ c om
749
+ Ġex ample
750
+ Ġsu pp
751
+ } \
752
+ n ess
753
+ Ġm in
754
+ Ġcon st
755
+ iv id
756
+ Ġimp ort
757
+ Ġte chn
758
+ ic es
759
+ ) )
760
+ el d
761
+ Ġdo es
762
+ Ġ ke
763
+ is s
764
+ Ġm ethod
765
+ Ġh igh
766
+ Ġw ay
767
+ Ġc alcul
768
+ Ġ Q
769
+ Ġinc re
770
+ m ath
771
+ Ġre qu
772
+ form ation
773
+ ³³ ³³
774
+ ect ion
775
+ ur n
776
+ ĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠ ĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠ
777
+ Ġhe alth
778
+ Ġl ine
779
+ ĠC om
780
+ Ġunder stand
781
+ Ġw ell
782
+ Ġ2 00
783
+ i qu
784
+ at or
785
+ id ent
786
+ Ġb oth
787
+ Ġev en
788
+ e x
789
+ Ġ :
790
+ iz ed
791
+ Ġp ers
792
+ u ch
793
+ Ġ Âł
794
+ c l
795
+ Ġb u
796
+ Ġc all
797
+ Ġin s
798
+ ĠU n
799
+ Ġr ight
800
+ Ġqu est
801
+ v ing
802
+ w or
803
+ ter n
804
+ olog y
805
+ i x
806
+ w ard
807
+ ar ch
808
+ Ġbec ause
809
+ Ġa p
810
+ t s
811
+ Ġpart ic
812
+ in ed
813
+ 1 9
814
+ c ial
815
+ Ġp ar
816
+ i eld
817
+ Ġm ult
818
+ a w
819
+ in al
820
+ as es
821
+ Ġ ed
822
+ ow n
823
+ d er
824
+ oc i
825
+ il y
826
+ ot her
827
+ Ġwh ile
828
+ Ġ z
829
+ ag es
830
+ Ġ1 2
831
+ Ġl ong
832
+ if e
833
+ Ġ )
834
+ od e
835
+ id er
836
+ Ġ ,
837
+ ut e
838
+ Ġt est
839
+ Ġ ent
840
+ o y
841
+ Ġp at
842
+ Ġex t
843
+ Ġan al
844
+ ual ly
845
+ al ity
846
+ it ive
847
+ erg y
848
+ Ġch ar
849
+ Ġme as
850
+ Ġde p
851
+ Ġ /
852
+ .. ..
853
+ re nt
854
+ Ġw ater
855
+ o ol
856
+ l ine
857
+ Ġ *
858
+ is m
859
+ ist s
860
+ v ent
861
+ t y
862
+ Ġ end
863
+ h ip
864
+ enc y
865
+ ĠA l
866
+ 1 5
867
+ ion al
868
+ Ġp ower
869
+ Ġ <
870
+ Ġg iven
871
+ ĠA n
872
+ Ġm ed
873
+ Ġh ad
874
+ Ġar t
875
+ ir c
876
+ Ġat t
877
+ . ,
878
+ re n
879
+ om et
880
+ a ve
881
+ ant s
882
+ Ġpro g
883
+ ere d
884
+ Ġl ar
885
+ c on
886
+ Ġcomm un
887
+ 1 3
888
+ Ġ ve
889
+ oc k
890
+ if y
891
+ ad e
892
+ w n
893
+ Ġ '
894
+ g an
895
+ Ġc ent
896
+ in ce
897
+ et s
898
+ Ġ `
899
+ Ġc ar
900
+ ĠA s
901
+ iz ation
902
+ Ġs k
903
+ Ġwor ld
904
+ Ġch ild
905
+ ub l
906
+ pl es
907
+ re st
908
+ Ġth ose
909
+ Ġst art
910
+ Ġe le
911
+ it ions
912
+ 2 5
913
+ e g
914
+ Ġle vel
915
+ p r
916
+ ĠY ou
917
+ Ġcl ass
918
+ w er
919
+ le ft
920
+ m er
921
+ i o
922
+ Ġpos s
923
+ Ġre ad
924
+ 1 6
925
+ } $
926
+ Ġa fter
927
+ Ġo pt
928
+ Ġle ad
929
+ Ġ her
930
+ Ġproble m
931
+ Ġ$ $
932
+ Ġp ol
933
+ l ed
934
+ Ġsm all
935
+ Ġg rou
936
+ 1 4
937
+ Ġm ain
938
+ g er
939
+ Ġfollow ing
940
+ Ġp ract
941
+ c i
942
+ im ate
943
+ Ġl oc
944
+ c er
945
+ Ġdes ign
946
+ id es
947
+ us s
948
+ Ġd ire
949
+ Ġd uring
950
+ v ed
951
+ c ent
952
+ Ġa ut
953
+ Ġcon d
954
+ Ġme an
955
+ et y
956
+ v es
957
+ Ġ est
958
+ Ġre se
959
+ Th is
960
+ Ġb ack
961
+ ro ss
962
+ Ġm uch
963
+ Ġ Î
964
+ ir on
965
+ od y
966
+ Ġin formation
967
+ Ġre al
968
+ Ġe ar
969
+ Ġ X
970
+ Ġimport ant
971
+ Ġ very
972
+ Ġre du
973
+ Ġf ound
974
+ g r
975
+ Ġal low
976
+ ar m
977
+ ak es
978
+ it ed
979
+ Ġwith in
980
+ Ġh um
981
+ Ġstud ents
982
+ Ġm on
983
+ Ġbe ing
984
+ Ġe lect
985
+ Ġl ess
986
+ re ad
987
+ Ġen ergy
988
+ t o
989
+ t ed
990
+ i er
991
+ Ġle t
992
+ Ġm ust
993
+ c k
994
+ Ġyear s
995
+ ĠC on
996
+ v al
997
+ Ġo per
998
+ g g
999
+ a ir
1000
+ Ġ$ \
1001
+ Ġres p
1002
+ he re
1003
+ is ion
1004
+ 5 0
1005
+ ate g
1006
+ Ġre t
1007
+ Ġt ake
1008
+ Ġpl ay
1009
+ it al
1010
+ in s
1011
+ Ġcon f
1012
+ u p
1013
+ Ġval ues
1014
+ ra y
1015
+ Ġc ount
1016
+ ivid ual
1017
+ ĠW hat
1018
+ Ġst ate
1019
+ Ġm ight
1020
+ Ġg u
1021
+ Ġnum bers
1022
+ er ing
1023
+ e w
1024
+ ro du
1025
+ iv ity
1026
+ ro l
1027
+ and s
1028
+ ĠâĢ ¢
1029
+ 1 8
1030
+ Ġt ra
1031
+ Ġc a
1032
+ Ġg row
1033
+ Ġs he
1034
+ Ġp ot
1035
+ Ġan s
1036
+ Ġa v
1037
+ Ġ #
1038
+ Ġv ol
1039
+ ress ion
1040
+ Ġ ident
1041
+ Ġw ant
1042
+ Ġm et
1043
+ ĠH e
1044
+ o x
1045
+ ĠThe se
1046
+ o ver
1047
+ Ġsec ond
1048
+ Ġcont in
1049
+ ) ;
1050
+ Ġth ree
1051
+ Ġof ten
1052
+ ul l
1053
+ ] ,
1054
+ Ġpers on
1055
+ Ġc ase
1056
+ v iron
1057
+ Ġd own
1058
+ Ġsign ific
1059
+ at ic
1060
+ u nd
1061
+ al e
1062
+ d d
1063
+ Ġpl an
1064
+ m a
1065
+ ul ation
1066
+ ð Ŀ
1067
+ Ġprodu ct
1068
+ Ġs er
1069
+ ĠThe y
1070
+ / /
1071
+ Ġper form
1072
+ = =
1073
+ Ġind ividual
1074
+ Ġbe fore
1075
+ eng th
1076
+ Ġa round
1077
+ 1 7
1078
+ â Ī
1079
+ 2 2
1080
+ are d
1081
+ ct ions
1082
+ Ġrequ ire
1083
+ Ġg l
1084
+ ag n
1085
+ Ġn on
1086
+ p os
1087
+ Ġsupp ort
1088
+ ot e
1089
+ r on
1090
+ ect ed
1091
+ Ġpro per
1092
+ ch ool
1093
+ ater ial
1094
+ Ġad v
1095
+ Ġstud y
1096
+ ct or
1097
+ ot s
1098
+ Ġequ ation
1099
+ Ġ1 8
1100
+ Ġen g
1101
+ p ar
1102
+ Ġch ange
1103
+ Ġh ist
1104
+ ut ions
1105
+ Ġl ife
1106
+ Ġob ject
1107
+ Ġg ood
1108
+ Ġcall ed
1109
+ Ġs um
1110
+ âĢ ĵ
1111
+ sel f
1112
+ Ġn ow
1113
+ ab les
1114
+ Ġty p
1115
+ Ġo wn
1116
+ Ġp op
1117
+ at her
1118
+ ri x
1119
+ Ġcon n
1120
+ en ces
1121
+ Ġor der
1122
+ 3 0
1123
+ Ġst and
1124
+ v en
1125
+ ys is
1126
+ am et
1127
+ f or
1128
+ Ġs l
1129
+ Ġf am
1130
+ an y
1131
+ Ġl it
1132
+ Ġmult i
1133
+ Ġimp ro
1134
+ Ġt em
1135
+ Ġinte rest
1136
+ wor k
1137
+ act er
1138
+ ol ution
1139
+ Ġmeas ure
1140
+ Ġsy m
1141
+ il ar
1142
+ Ġ1 5
1143
+ i vers
1144
+ Ġf in
1145
+ ĠS o
1146
+ p ort
1147
+ Ġ ï
1148
+ Ġpro f
1149
+ t a
1150
+ Ġlear n
1151
+ Ġcomm on
1152
+ Ġcur rent
1153
+ Ġc le
1154
+ Ġ ide
1155
+ ĠW h
1156
+ Ġe as
1157
+ Ġst ep
1158
+ ĠB y
1159
+ 2 4
1160
+ Ġhe re
1161
+ Ġd on
1162
+ Ġto p
1163
+ Ġc ell
1164
+ Ġr is
1165
+ Ġb ased
1166
+ Ġh y
1167
+ Ġpro b
1168
+ Ġm em
1169
+ in ation
1170
+ Ġag ain
1171
+ ĠĠĠĠ ĠĠĠ
1172
+ ĠThe re
1173
+ Ġc irc
1174
+ Ġc are
1175
+ Ġdet erm
1176
+ ( \
1177
+ Ġme ans
1178
+ er r
1179
+ ĠT o
1180
+ Ġf ield
1181
+ os s
1182
+ b r
1183
+ ain s
1184
+ Ġbe h
1185
+ Ġto o
1186
+ Ġex am
1187
+ o int
1188
+ ver se
1189
+ Ġc ap
1190
+ um e
1191
+ ition al
1192
+ Ġinv ol
1193
+ ĠÂł ĠÂł
1194
+ ent al
1195
+ Ġen viron
1196
+ t le
1197
+ im al
1198
+ Ġv is
1199
+ A T
1200
+ ff ic
1201
+ 2 3
1202
+ Ġo p
1203
+ Ġpro t
1204
+ Ġm ade
1205
+ Ġcor re
1206
+ d ay
1207
+ e ad
1208
+ iqu e
1209
+ er t
1210
+ r t
1211
+ Ġf re
1212
+ Ġch ang
1213
+ l ess
1214
+ ig ure
1215
+ Ġwor d
1216
+ Ġ Â
1217
+ iv ing
1218
+ t t
1219
+ Ġc ult
1220
+ Ġcomp ut
1221
+ Ġ >
1222
+ ĠB ut
1223
+ Ġb as
1224
+ st r
1225
+ Ġcomple x
1226
+ 9 9
1227
+ Ġs qu
1228
+ Ġm aterial
1229
+ o id
1230
+ Ġen s
1231
+ Ġcons ider
1232
+ en se
1233
+ Ġd el
1234
+ Ġc ost
1235
+ Ġde m
1236
+ ĠA nd
1237
+ Ġvari ous
1238
+ Ġ1 6
1239
+ Ġpot ential
1240
+ Ġc he
1241
+ Ġwith out
1242
+ an k
1243
+ Ġare a
1244
+ s c
1245
+ Ġlear ning
1246
+ ar s
1247
+ i od
1248
+ Ġl im
1249
+ Ġt rad
1250
+ Ġh and
1251
+ Ġth ough
1252
+ pt ion
1253
+ Ġsignific ant
1254
+ Ġb re
1255
+ r m
1256
+ Ġs erv
1257
+ ver t
1258
+ w ays
1259
+ pl ay
1260
+ n er
1261
+ ĠS h
1262
+ ul a
1263
+ âĢ Ķ
1264
+ Ġdist rib
1265
+ re t
1266
+ Ġp resent
1267
+ Ġrep resent
1268
+ Ġsol ution
1269
+ Ġab ove
1270
+ Ġp ost
1271
+ Ġst ruct
1272
+ Ġresult s
1273
+ oc ial
1274
+ Ġde v
1275
+ ĠHow ever
1276
+ Ġo cc
1277
+ Ġbet ter
1278
+ Ġan other
1279
+ Ġd ay
1280
+ Ġan g
1281
+ Ġe l
1282
+ er n
1283
+ Ġbe l
1284
+ Ġph ys
1285
+ i or
1286
+ Ġa ff
1287
+ an ces
1288
+ i ents
1289
+ our ces
1290
+ 3 3
1291
+ Ġc our
1292
+ Ġposs ible
1293
+ Ġd id
1294
+ Ġpoint s
1295
+ y m
1296
+ et ic
1297
+ or ing
1298
+ Ġg re
1299
+ if ied
1300
+ Ġ ess
1301
+ Ġb r
1302
+ Ġt er
1303
+ Ġw rit
1304
+ Ġdes c
1305
+ Ġp ubl
1306
+ Ġor gan
1307
+ v iew
1308
+ Ġsp ace
1309
+ âĶ Ĥ
1310
+ end s
1311
+ Ġ1 4
1312
+ Ġbu ild
1313
+ Ġg ra
1314
+ Ġinclud ing
1315
+ Ġquest ion
1316
+ Ġequ al
1317
+ Ġl ight
1318
+ ĠC l
1319
+ ĠS c
1320
+ Ġ }
1321
+ p or
1322
+ as h
1323
+ in ess
1324
+ ter s
1325
+ Ġch all
1326
+ I f
1327
+ Ġl ook
1328
+ f ace
1329
+ Ġth ink
1330
+ Ġ Z
1331
+ c ing
1332
+ Ġe t
1333
+ Ġcre ate
1334
+ our ce
1335
+ y le
1336
+ ĠI nd
1337
+ b s
1338
+ Ġb ody
1339
+ Ġknow n
1340
+ Ġrese arch
1341
+ or ies
1342
+ o ad
1343
+ Ġs om
1344
+ as on
1345
+ Ġty pe
1346
+ Ġt ri
1347
+ Ġt reat
1348
+ Ġo pp
1349
+ Ġf ood
1350
+ Ġis s
1351
+ Ġr ate
1352
+ eth ing
1353
+ ur ther
1354
+ hem at
1355
+ ive ly
1356
+ Ġt imes
1357
+ Ġ1 1
1358
+ Ġpro ject
1359
+ Ġd ig
1360
+ Ġ rad
1361
+ ĠQ u
1362
+ Ġl ist
1363
+ Ġd ue
1364
+ Ġm ark
1365
+ ist ic
1366
+ Ġlar ge
1367
+ Ġpro m
1368
+ Ġa w
1369
+ l u
1370
+ Ġprov ide
1371
+ W e
1372
+ g or
1373
+ Ġans wer
1374
+ Ġcom b
1375
+ A A
1376
+ Ġg raph
1377
+ Ġgrou p
1378
+ cc ess
1379
+ Ġp ass
1380
+ ro p
1381
+ ang u
1382
+ Ġhum an
1383
+ Ġap plic
1384
+ te m
1385
+ Ġcont rol
1386
+ Ġ Ã
1387
+ `` `
1388
+ Ġenviron ment
1389
+ el s
1390
+ Ġproble ms
1391
+ ) :
1392
+ r al
1393
+ Ġp ur
1394
+ Ġb en
1395
+ 00 00
1396
+ ith m
1397
+ Ġsystem s
1398
+ ĠW hen
1399
+ a pe
1400
+ Ġinte gr
1401
+ oc us
1402
+ u g
1403
+ Ġsom ething
1404
+ 4 0
1405
+ Ġst ill
1406
+ b e
1407
+ 6 0
1408
+ Ġd ra
1409
+ Ġpartic ular
1410
+ Ġspec ific
1411
+ Ġp ress
1412
+ Ġm ove
1413
+ Ġ1 3
1414
+ Ġf low
1415
+ mer ic
1416
+ im um
1417
+ t al
1418
+ ent ion
1419
+ ĠR es
1420
+ er tain
1421
+ er o
1422
+ i ke
1423
+ Ġb est
1424
+ ac es
1425
+ l ing
1426
+ a pp
1427
+ ill s
1428
+ E R
1429
+ Ġc rit
1430
+ Ġl og
1431
+ Ġstand ard
1432
+ ent ly
1433
+ 2 8
1434
+ -------- --------
1435
+ Ġinv est
1436
+ b ra
1437
+ Ġob s
1438
+ ĠâĪ Ĵ
1439
+ Ġto ol
1440
+ Ġor ig
1441
+ Ġin du
1442
+ E x
1443
+ W hat
1444
+ Ġwor ks
1445
+ Ġwh y
1446
+ Ġsa f
1447
+ Ġl ength
1448
+ ou n
1449
+ Ġs chool
1450
+ ver age
1451
+ o le
1452
+ Ġd r
1453
+ Ġunderstand ing
1454
+ om s
1455
+ Ġha pp
1456
+ Ġs it
1457
+ Ġp res
1458
+ Ġw r
1459
+ Ġs ince
1460
+ Ġs ize
1461
+ 2 7
1462
+ A s
1463
+ Ġs ay
1464
+ " ,
1465
+ Ġchild ren
1466
+ Ġinclud e
1467
+ Ġrel ations
1468
+ Ġke ep
1469
+ Ġm ass
1470
+ Ġn orm
1471
+ el f
1472
+ i um
1473
+ n am
1474
+ Ġh ig
1475
+ p ro
1476
+ 2 01
1477
+ Ġm aking
1478
+ us ion
1479
+ Ġed uc
1480
+ n ot
1481
+ ic le
1482
+ is hed
1483
+ Ġpl ace
1484
+ Ġn et
1485
+ Ġt re
1486
+ Ġper iod
1487
+ Ġprov id
1488
+ iz ing
1489
+ S t
1490
+ Ġprog ram
1491
+ Ġ1 00
1492
+ Ġm ot
1493
+ Ġtr y
1494
+ Ġs ing
1495
+ 2 1
1496
+ ord ing
1497
+ Ġto get
1498
+ Ġtoget her
1499
+ r ation
1500
+ op e
1501
+ Ġr un
1502
+ Ġdisc uss
1503
+ Ġke y
1504
+ Ġpre d
1505
+ Ġin it
1506
+ ĠP l
1507
+ ĠD e
1508
+ Ġfe el
1509
+ Ġfre qu
1510
+ olog ical
1511
+ Ġre st
1512
+ Ġt erm
1513
+ Ġpos itive
1514
+ Ġimp act
1515
+ Ġs ocial
1516
+ Ġanal ysis
1517
+ ĠA meric
1518
+ Ġn at
1519
+ Ġc y
1520
+ ĠI s
1521
+ ang le
1522
+ H ow
1523
+ Ġp a
1524
+ ap ter
1525
+ v ious
1526
+ a h
1527
+ Ġ3 0
1528
+ Ġv iew
1529
+ og n
1530
+ Ġam ount
1531
+ ĠI m
1532
+ um ent
1533
+ Ġne g
1534
+ at ors
1535
+ Ġsa id
1536
+ Ġsim ple
1537
+ e e
1538
+ ____ ____
1539
+ ĠĠĠĠ Ġ
1540
+ Ġm ax
1541
+ an e
1542
+ Ġen c
1543
+ 2 6
1544
+ m e
1545
+ Ġse ver
1546
+ her s
1547
+ Ġal ways
1548
+ Ġl ow
1549
+ il ities
1550
+ Ġacc ess
1551
+ in ing
1552
+ Ġto tal
1553
+ Ġcon cept
1554
+ Ġf ocus
1555
+ F or
1556
+ c o
1557
+ om en
1558
+ Ġtem per
1559
+ Ġb us
1560
+ Ġess ential
1561
+ Ġdevelop ment
1562
+ Ġl aw
1563
+ I t
1564
+ ir d
1565
+ age ment
1566
+ Ġ1 7
1567
+ iv ed
1568
+ im ens
1569
+ Ġr ange
1570
+ end ing
1571
+ ĠP h
1572
+ Ġst re
1573
+ ere nce
1574
+ ut ure
1575
+ em ber
1576
+ as ing
1577
+ ce l
1578
+ Ġop en
1579
+ Ġwe ight
1580
+ 2 9
1581
+ Ġsim ilar
1582
+ âĢ ¦
1583
+ Ġbe low
1584
+ 4 5
1585
+ ic ation
1586
+ Ġg reat
1587
+ Ġquest ions
1588
+ Ġth ings
1589
+ Ġs ide
1590
+ e qu
1591
+ ĠT e
1592
+ Ġf il
1593
+ Ġdire ct
1594
+ Ġim m
1595
+ u le
1596
+ er c
1597
+ Ġchar acter
1598
+ Ġres pect
1599
+ ðĿ ij
1600
+ Ġc ertain
1601
+ Ġl angu
1602
+ Ġde g
1603
+ id s
1604
+ Ġform ula
1605
+ Ġl ast
1606
+ T o
1607
+ con om
1608
+ an n
1609
+ Ġmat rix
1610
+ Ġg r
1611
+ Ġter ms
1612
+ Ġris k
1613
+ Ġstr ateg
1614
+ Ġca us
1615
+ at s
1616
+ Ġal ong
1617
+ Ġben ef
1618
+ Ġf ree
1619
+ Ġcont rib
1620
+ Ġ2 5
1621
+ âĶ ģ
1622
+ Ġcond itions
1623
+ Ġm us
1624
+ p y
1625
+ g in
1626
+ ĠT r
1627
+ id ence
1628
+ Ġbec ome
1629
+ Ġa ir
1630
+ Ġle ft
1631
+ in ary
1632
+ d is
1633
+ ĠâĢ ĺ
1634
+ i k
1635
+ ivers ity
1636
+ . âĢĿ
1637
+ Ġsever al
1638
+ Ġun it
1639
+ ĠW or
1640
+ ĠE ng
1641
+ a j
1642
+ Ġac ross
1643
+ Ġm ar
1644
+ it ud
1645
+ Ġ ...
1646
+ are nt
1647
+ it her
1648
+ Ġal gor
1649
+ Ġ err
1650
+ ward s
1651
+ Ġother s
1652
+ pl oy
1653
+ Ġfun ctions
1654
+ C h
1655
+ t on
1656
+ iv al
1657
+ ĠTh at
1658
+ b y
1659
+ Ġass oci
1660
+ Ġh ome
1661
+ âĶģ âĶģ
1662
+ Ġpar amet
1663
+ ĠN ew
1664
+ os ed
1665
+ Ġm ov
1666
+ Ġst at
1667
+ Ġrelations hip
1668
+ Ġte xt
1669
+ 8 0
1670
+ Ġne xt
1671
+ Ġappro ach
1672
+ Ġchall eng
1673
+ Ġspe ed
1674
+ Ġocc ur
1675
+ I N
1676
+ Ġam ong
1677
+ n al
1678
+ ort un
1679
+ Ġav ail
1680
+ b ol
1681
+ ĠL et
1682
+ ĠE n
1683
+ Ġcorre ct
1684
+ Ġ\ $
1685
+ led ge
1686
+ 3 5
1687
+ Ġf ac
1688
+ 3 6
1689
+ Ġwe e
1690
+ ab or
1691
+ at ures
1692
+ Ġb o
1693
+ Ġf our
1694
+ | |
1695
+ g es
1696
+ Ġcomp on
1697
+ Ġdis e
1698
+ Ġb i
1699
+ ag ing
1700
+ Ġsu ccess
1701
+ Ġdesc rib
1702
+ Ġgener al
1703
+ Ġeff ic
1704
+ Ġcour se
1705
+ Ġd iv
1706
+ 7 5
1707
+ Ġw ays
1708
+ Ġin put
1709
+ Ġbel ie
1710
+ ly ing
1711
+ âĶĢâĶĢâĶĢâĶĢâĶĢâĶĢâĶĢâĶĢ âĶĢâĶĢâĶĢâĶĢâĶĢâĶĢâĶĢâĶĢ
1712
+ s p
1713
+ Ġfor ce
1714
+ Ġ es
1715
+ O N
1716
+ Ġle g
1717
+ : //
1718
+ Ġfact ors
1719
+ h y
1720
+ Ġbeh av
1721
+ Ġro le
1722
+ ort s
1723
+ of t
1724
+ Ġg ive
1725
+ y stem
1726
+ Ġse em
1727
+ Ġsur face
1728
+ math b
1729
+ Ġmethod s
1730
+ ple ment
1731
+ Ġne cess
1732
+ m in
1733
+ Ġcont ain
1734
+ r ies
1735
+ Ġc ode
1736
+ en er
1737
+ Ġan t
1738
+ Ġt rain
1739
+ w w
1740
+ ĠW ith
1741
+ ra ction
1742
+ Ġconst ant
1743
+ ) $
1744
+ Ġspec ial
1745
+ our s
1746
+ ou se
1747
+ Ġp ric
1748
+ Ġf uture
1749
+ Ġ Ï
1750
+ Ġ âĶĤ
1751
+ og raph
1752
+ Ġact iv
1753
+ 2 00
1754
+ ge bra
1755
+ Ġqu ant
1756
+ ĠO r
1757
+ Ġsing le
1758
+ Ġdistrib ution
1759
+ ap s
1760
+ Ġd er
1761
+ oo ks
1762
+ ĠO n
1763
+ Ġimpro ve
1764
+ ) =
1765
+ q rt
1766
+ i ation
1767
+ h or
1768
+ ## ##
1769
+ Ġnat ural
1770
+ ar ing
1771
+ Ġhig her
1772
+ ist ics
1773
+ l ish
1774
+ Ġsqu are
1775
+ Ġun ique
1776
+ Ġex ist
1777
+ Ġgo ver
1778
+ Ġab le
1779
+ am es
1780
+ ep end
1781
+ Ġcontin u
1782
+ Ġobs erv
1783
+ ate ly
1784
+ Ġs w
1785
+ } _{
1786
+ Ġloc al
1787
+ ore d
1788
+ Ġele ments
1789
+ Ġtr ue
1790
+ Ġline ar
1791
+ ific ation
1792
+ Ġh ard
1793
+ ut es
1794
+ ur y
1795
+ le ction
1796
+ pl ied
1797
+ Ġchang es
1798
+ Ġ\ (
1799
+ a z
1800
+ nd om
1801
+ Ġret urn
1802
+ ĠA r
1803
+ Ġexper ience
1804
+ 4 4
1805
+ Ġagain st
1806
+ om m
1807
+ Ġs elf
1808
+ Ġpress ure
1809
+ Ġequ ations
1810
+ ĠM at
1811
+ ch an
1812
+ Ġfe w
1813
+ Ġtyp es
1814
+ i res
1815
+ ĠL e
1816
+ Ġdist ance
1817
+ Ġpo ly
1818
+ ib ility
1819
+ Ġhist ory
1820
+ Ġp ath
1821
+ c y
1822
+ 9 0
1823
+ Ġm ill
1824
+ Ġs ens
1825
+ Ġexper i
1826
+ Ġm akes
1827
+ Ġmon th
1828
+ Ġsh ort
1829
+ Ġf ri
1830
+ Ġcomple te
1831
+ Ġg e
1832
+ Ġavail able
1833
+ Ġgo ing
1834
+ an ced
1835
+ Ġu nt
1836
+ > >
1837
+ u ro
1838
+ Ġshow n
1839
+ ĠO ne
1840
+ Ġbus iness
1841
+ Ġdiffere nce
1842
+ Ġre le
1843
+ ire d
1844
+ ight s
1845
+ Ġ q
1846
+ Ġle ast
1847
+ Ġcom e
1848
+ ĠA d
1849
+ in c
1850
+ end ed
1851
+ ard s
1852
+ le t
1853
+ gg est
1854
+ l am
1855
+ Ġcle ar
1856
+ Ġincre ase
1857
+ Ġind ic
1858
+ Ġob tain
1859
+ Ġneed s
1860
+ .... ....
1861
+ Ġfact or
1862
+ Ġp ut
1863
+ 6 6
1864
+ Ġch o
1865
+ vers ion
1866
+ am p
1867
+ f er
1868
+ id d
1869
+ ist ance
1870
+ Ġe conom
1871
+ Ġp ain
1872
+ Ġwhe ther
1873
+ c os
1874
+ th ing
1875
+ l and
1876
+ 7 0
1877
+ The re
1878
+ b o
1879
+ A n
1880
+ ab ly
1881
+ Ġb ound
1882
+ Ġar g
1883
+ E S
1884
+ it ing
1885
+ s et
1886
+ oo king
1887
+ c le
1888
+ ic ult
1889
+ Ġindividual s
1890
+ Ġf ore
1891
+ Ġout put
1892
+ Ġsu re
1893
+ . "
1894
+ Ġstr ong
1895
+ Ġexp ress
1896
+ Ġs oci
1897
+ ĠS p
1898
+ ch ie
1899
+ Ġlevel s
1900
+ Ġre ce
1901
+ Ġpa per
1902
+ m it
1903
+ m at
1904
+ Ġse qu
1905
+ Ġve ctor
1906
+ m an
1907
+ Ġconn ect
1908
+ Ġtechn ology
1909
+ n ces
1910
+ w are
1911
+ Ġf urther
1912
+ Ġacc ount
1913
+ 4 8
1914
+ Ġper cent
1915
+ iss ion
1916
+ w here
1917
+ st yle
1918
+ ] .
1919
+ 9 5
1920
+ Ġmain tain
1921
+ Ġword s
1922
+ pe cial
1923
+ om es
1924
+ Ġc r
1925
+ p i
1926
+ t ies
1927
+ Ġtemper ature
1928
+ Ġgrow th
1929
+ Ġha ving
1930
+ Ġgover n
1931
+ Ġ5 0
1932
+ ast er
1933
+ Ġresp ons
1934
+ 3 8
1935
+ Ġm ath
1936
+ Ġfl u
1937
+ o ot
1938
+ Ġl ower
1939
+ ĠC an
1940
+ Ġn ame
1941
+ ) (
1942
+ s ing
1943
+ a pt
1944
+ iqu es
1945
+ Ġpre vent
1946
+ Ġa verage
1947
+ } ,
1948
+ ic ro
1949
+ Ġwor king
1950
+ Ġsu ggest
1951
+ ĠM e
1952
+ te p
1953
+ Ġinf lu
1954
+ act ion
1955
+ Ġex act
1956
+ Ġnum er
1957
+ Ġprob ability
1958
+ 1 00
1959
+ is ed
1960
+ Ġh im
1961
+ Ġsk ills
1962
+ Ġz ero
1963
+ Ġpubl ic
1964
+ Ġm agn
1965
+ est ion
1966
+ al u
1967
+ Ġlangu age
1968
+ Ġ ill
1969
+ ) \
1970
+ Ġinit ial
1971
+ Ġanal y
1972
+ Ġpract ice
1973
+ Ġt al
1974
+ Ġd om
1975
+ Ġs at
1976
+ Ġvari able
1977
+ ( )
1978
+ ar c
1979
+ Ġknow ledge
1980
+ at ch
1981
+ Ġare as
1982
+ Ġr at
1983
+ Ġstruct ure
1984
+ Ġfam ily
1985
+ Ġdet ail
1986
+ Ġser ies
1987
+ st it
1988
+ N ow
1989
+ ) /
1990
+ Ġd y
1991
+ P ro
1992
+ 3 7
1993
+ ĠA t
1994
+ Ġra ndom
1995
+ Ġneg ative
1996
+ Ġtreat ment
1997
+ pl ace
1998
+ , âĢĿ
1999
+ ĠC ol
2000
+ oo se
2001
+ Ġab s
2002
+ du ct
2003
+ Ġadd ress
2004
+ Ġm il
2005
+ Ġb ook
2006
+ ffic ient
2007
+ A l
2008
+ Ġt able
2009
+ Ġperform ance
2010
+ Ġ2 4
2011
+ Ġens ure
2012
+ Ġa chie
2013
+ Ġo ld
2014
+ Ġf ar
2015
+ } ^{
2016
+ Ġapp ear
2017
+ 3 4
2018
+ res p
2019
+ ore m
2020
+ Ġrem ain
2021
+ Ġim plement
2022
+ s h
2023
+ A R
2024
+ Ġsol ve
2025
+ Ġmat hemat
2026
+ Ġiss ues
2027
+ O R
2028
+ Ġp ay
2029
+ Ġm om
2030
+ Ġh old
2031
+ Ġhe ad
2032
+ `` ``
2033
+ Ġcol l
2034
+ Ġrequire d
2035
+ itud e
2036
+ Ġcell s
2037
+ Ġprof ess
2038
+ Ġpos ition
2039
+ ob al
2040
+ âĪ Ĵ
2041
+ Ġf ull
2042
+ Ġl oss
2043
+ Ġshow s
2044
+ Y ou
2045
+ ĠĠĠĠ ĠĠ
2046
+ Ġmulti ple
2047
+ al f
2048
+ ust om
2049
+ Ġpred ict
2050
+ i ans
2051
+ Ġe ither
2052
+ ³³³³ ³³³³
2053
+ Ġc ause
2054
+ Ġl ay
2055
+ ' re
2056
+ âĢ ľ
2057
+ Ġk ind
2058
+ Ġre ally
2059
+ k ed
2060
+ w h
2061
+ Ġdef in
2062
+ ou ra
2063
+ ĠA ll
2064
+ Ġre ason
2065
+ Ġse lect
2066
+ S o
2067
+ Ġhelp s
2068
+ av es
2069
+ Ġd ays
2070
+ Ġint rodu
2071
+ ra ms
2072
+ \ $
2073
+ at ives
2074
+ a ut
2075
+ ix ed
2076
+ Ġvari ables
2077
+ Ġsol utions
2078
+ Ġunt il
2079
+ ens ity
2080
+ Ġlit tle
2081
+ Ġc ases
2082
+ Ġen ough
2083
+ u se
2084
+ m et
2085
+ Ġphys ical
2086
+ Ġche ck
2087
+ Ġb ro
2088
+ Ġm ind
2089
+ Ġres ources
2090
+ o h
2091
+ ric t
2092
+ one y
2093
+ um ber
2094
+ ) ^
2095
+ ĠUn iversity
2096
+ s ide
2097
+ Ġne ar
2098
+ Ġbe gin
2099
+ play style
2100
+ 9 8
2101
+ Ġrep ort
2102
+ re l
2103
+ Ġb al
2104
+ Ġexpl ore
2105
+ ar r
2106
+ Ġpr im
2107
+ om ial
2108
+ Ġsc ient
2109
+ ar get
2110
+ Ġear ly
2111
+ Ġm ach
2112
+ ur ns
2113
+ ** **
2114
+ Ġte am
2115
+ on es
2116
+ ĠS im
2117
+ Ġem ploy
2118
+ Ġang le
2119
+ aj or
2120
+ Ġt urn
2121
+ Ġb ig
2122
+ is ing
2123
+ at ter
2124
+ Ġnorm al
2125
+ ĠA dd
2126
+ Ġassoci ated
2127
+ se qu
2128
+ 5 5
2129
+ Ġon line
2130
+ Ġto day
2131
+ ru ction
2132
+ Ġest im
2133
+ ĠS u
2134
+ Ġsit u
2135
+ omet imes
2136
+ Ġev alu
2137
+ ul es
2138
+ s qrt
2139
+ Ġdiff icult
2140
+ Ġdra w
2141
+ c d
2142
+ Ġc ru
2143
+ 7 8
2144
+ us h
2145
+ Ġcalcul ate
2146
+ Ġthe ory
2147
+ A L
2148
+ g en
2149
+ Ġpre c
2150
+ in king
2151
+ Ġf und
2152
+ ram e
2153
+ Ġexper im
2154
+ ag ine
2155
+ Ġele ment
2156
+ in ci
2157
+ s y
2158
+ . )
2159
+ Ġd one
2160
+ ast ic
2161
+ Ġcommun ity
2162
+ Ġen h
2163
+ or n
2164
+ is es
2165
+ Ġa ge
2166
+ Ġst ress
2167
+ Ġallow s
2168
+ ĠThe n
2169
+ ro ll
2170
+ == ==
2171
+ Ġbl ood
2172
+ Ġgrou ps
2173
+ Ġs ample
2174
+ 9 6
2175
+ Ġcon cer
2176
+ Ġeffect s
2177
+ os p
2178
+ Ġqu ality
2179
+ m ing
2180
+ ĠM ath
2181
+ resp ond
2182
+ Ġcl ose
2183
+ 3 2
2184
+ th ough
2185
+ Ġmark et
2186
+ ord in
2187
+ al es
2188
+ Ġaff ect
2189
+ dis playstyle
2190
+ ak en
2191
+ Ġmaterial s
2192
+ m on
2193
+ p art
2194
+ al le
2195
+ ĠSt ud
2196
+ ne w
2197
+ Ġpre vious
2198
+ ĠC ont
2199
+ ac y
2200
+ ound s
2201
+ Ġopp ortun
2202
+ R e
2203
+ Ġa x
2204
+ ĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠ ĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠ
2205
+ = \
2206
+ Ġp ast
2207
+ Ġdef ined
2208
+ $ .
2209
+ u it
2210
+ ri pt
2211
+ er ation
2212
+ ĠS ol
2213
+ Ġadd ition
2214
+ ĠB e
2215
+ ĠÃ Ĺ
2216
+ W hen
2217
+ Ġb ase
2218
+ I I
2219
+ Ġhe at
2220
+ Ġerr or
2221
+ ph a
2222
+ math rm
2223
+ Ġprov ides
2224
+ Ġexpl ain
2225
+ Ġcons um
2226
+ p ly
2227
+ Ġdise ase
2228
+ Ġperson al
2229
+ ne y
2230
+ an ks
2231
+ Ġalgor ithm
2232
+ Ġw ind
2233
+ Ġmodel s
2234
+ ĠS ome
2235
+ C on
2236
+ Ġcond ition
2237
+ r ing
2238
+ ĠM od
2239
+ Ġsub ject
2240
+ ĠI nt
2241
+ Ġp ie
2242
+ ac hes
2243
+ Ġass um
2244
+ Ġappro x
2245
+ ĠE qu
2246
+ c ome
2247
+ Ġcrit ical
2248
+ Ġs ource
2249
+ Ġus ually
2250
+ et a
2251
+ b it
2252
+ Ġtechn iques
2253
+ } {\
2254
+ sel ves
2255
+ Ġredu ce
2256
+ ĠE ar
2257
+ Ġ ver
2258
+ on se
2259
+ f act
2260
+ Ġinst ead
2261
+ ĠA ss
2262
+ Ġtrans form
2263
+ Ġl o
2264
+ Ġeng ine
2265
+ Ġpop ulation
2266
+ 4 6
2267
+ Ġeffect ive
2268
+ Â °
2269
+ am ples
2270
+ Ġcan not
2271
+ ur ity
2272
+ Ġsome one
2273
+ Ġme chan
2274
+ eg in
2275
+ Ġe y
2276
+ Ġrec ogn
2277
+ ou th
2278
+ Ġdeterm ine
2279
+ ĠâĢ Ķ
2280
+ un ction
2281
+ en ing
2282
+ Ġwr ite
2283
+ Ġart icle
2284
+ ĠP r
2285
+ Ġto wards
2286
+ Ġm ajor
2287
+ al ing
2288
+ ĠD is
2289
+ Ġcol lect
2290
+ Ġg round
2291
+ S T
2292
+ 0 5
2293
+ Ġgre ater
2294
+ Ġchalleng es
2295
+ Ġl ot
2296
+ a f
2297
+ ar ies
2298
+ pecial ly
2299
+ Ġs oft
2300
+ Ġt ell
2301
+ Ġcom es
2302
+ oc ity
2303
+ Ġl ines
2304
+ Ġact ually
2305
+ Ġneed ed
2306
+ Ġaw ay
2307
+ Ġpl ant
2308
+ Ġnecess ary
2309
+ Ġs ense
2310
+ ĠD es
2311
+ Ġorig inal
2312
+ 7 6
2313
+ Ġactiv ities
2314
+ Ġr ather
2315
+ Ġw omen
2316
+ Ġim age
2317
+ ĠB l
2318
+ Ġeduc ation
2319
+ ĠN e
2320
+ Ġqu ick
2321
+ ip s
2322
+ c al
2323
+ L et
2324
+ Ġcru cial
2325
+ Ġd en
2326
+ pl ies
2327
+ Ġj our
2328
+ i pp
2329
+ d f
2330
+ Ġup on
2331
+ cl usion
2332
+ Ġcor respond
2333
+ Ġro t
2334
+ Ġ ut
2335
+ ĠN o
2336
+ E N
2337
+ if t
2338
+ ot t
2339
+ en e
2340
+ Ġem b
2341
+ p re
2342
+ i us
2343
+ cul ar
2344
+ l t
2345
+ A N
2346
+ Ġtool s
2347
+ Ġas pect
2348
+ Ġpol ic
2349
+ i ver
2350
+ Ġdire ction
2351
+ Ġrel ated
2352
+ at ory
2353
+ Ġv ir
2354
+ Ġest ab
2355
+ Ġ vel
2356
+ 3 9
2357
+ read y
2358
+ Ġman agement
2359
+ Ġincre asing
2360
+ Ġeas y
2361
+ in a
2362
+ ĠD o
2363
+ Ġcons id
2364
+ le ase
2365
+ Ġide a
2366
+ ĠU S
2367
+ Ġe ver
2368
+ un e
2369
+ Ġd am
2370
+ on al
2371
+ Ġg ain
2372
+ ' ,
2373
+ Ġwho le
2374
+ i i
2375
+ Ġc ut
2376
+ Ġn ature
2377
+ ear ch
2378
+ c hes
2379
+ Ġprot ect
2380
+ Ġcol um
2381
+ Ġreg ular
2382
+ Ġev ent
2383
+ e b
2384
+ Ġfrequ ency
2385
+ Ġg ame
2386
+ ĠP er
2387
+ Ġlike ly
2388
+ Ġhe art
2389
+ Ġreg ard
2390
+ Ġident ify
2391
+ er y
2392
+ Ġcons ist
2393
+ ³³ ³
2394
+ ĠAmeric an
2395
+ f ect
2396
+ ou ble
2397
+ Ġh tt
2398
+ n ov
2399
+ Ġsh are
2400
+ Ġind epend
2401
+ Ġpric e
2402
+ c re
2403
+ Ġ **
2404
+ Ġpart s
2405
+ Ġ4 0
2406
+ ed i
2407
+ Ġmean ing
2408
+ Ġlit er
2409
+ Ġexp ression
2410
+ Ġad j
2411
+ Ġcon text
2412
+ Ġvol ume
2413
+ S E
2414
+ ĠE m
2415
+ Ġstre ng
2416
+ Q u
2417
+ Ġs ection
2418
+ w ise
2419
+ Ġar r
2420
+ Ġdoes n
2421
+ Ġem ot
2422
+ Ġt arget
2423
+ \ )
2424
+ s um
2425
+ Ġt as
2426
+ ach ing
2427
+ Ġc ustom
2428
+ Ġse par
2429
+ Ġrel ative
2430
+ le x
2431
+ Ġb all
2432
+ ul ations
2433
+ Ġrat io
2434
+ l ation
2435
+ Ġprodu ction
2436
+ Ġc al
2437
+ Ġde ep
2438
+ Ġal ready
2439
+ Ġ$$ \
2440
+ ĠC alcul
2441
+ nder stand
2442
+ I C
2443
+ ĠS e
2444
+ Ġlim it
2445
+ Ġb it
2446
+ an cial
2447
+ Ġacc ording
2448
+ Ġon ce
2449
+ Ġro ot
2450
+ , "
2451
+ Ġp arent
2452
+ ĠF ind
2453
+ Ġg ives
2454
+ Ġpat ients
2455
+ Ġl and
2456
+ Ġd ivid
2457
+ re g
2458
+ Ġstep s
2459
+ Ġg rad
2460
+ en ge
2461
+ Ġl ab
2462
+ Ġb rain
2463
+ Ġproduct s
2464
+ Ġcon ver
2465
+ Ġne ver
2466
+ l ike
2467
+ à ¤
2468
+ b ased
2469
+ Ġh ours
2470
+ ol l
2471
+ d e
2472
+ A C
2473
+ ict ion
2474
+ ĠM ore
2475
+ Ġd imens
2476
+ Ġc hem
2477
+ Ġst ory
2478
+ in ter
2479
+ ĠM ay
2480
+ Ġus es
2481
+ i ency
2482
+ Ġsc ience
2483
+ Ġes pecially
2484
+ g ed
2485
+ Ġl ater
2486
+ Ġpartic ip
2487
+ Ġp ort
2488
+ ĠM an
2489
+ Ġtra vel
2490
+ Ġhist or
2491
+ Ġbre ak
2492
+ a im
2493
+ l ight
2494
+ s in
2495
+ Ġf ail
2496
+ 4 7
2497
+ b l
2498
+ imate ly
2499
+ Ġex erc
2500
+ Ġcont ent
2501
+ ut ed
2502
+ Ġrec ord
2503
+ Ġsym bol
2504
+ Ġapplic ations
2505
+ p ot
2506
+ $ ,
2507
+ z e
2508
+ Ġthrough out
2509
+ Ġover all
2510
+ Ġyou ng
2511
+ 8 8
2512
+ Ġpr inci
2513
+ Ġf igure
2514
+ e y
2515
+ Ġpol it
2516
+ p ri
2517
+ Ġar ray
2518
+ k now
2519
+ ig en
2520
+ Ġ2 1
2521
+ Ġmod ern
2522
+ ' ll
2523
+ Ġact ivity
2524
+ on str
2525
+ Ġconsid ered
2526
+ ĠP re
2527
+ Ġt aking
2528
+ Ġse en
2529
+ } $$
2530
+ um p
2531
+ Ġstud ies
2532
+ Ġcol or
2533
+ Ġsu per
2534
+ Ġâ Ĩ
2535
+ Ġsim ply
2536
+ W h
2537
+ Ġl oad
2538
+ r ist
2539
+ t ime
2540
+ rac k
2541
+ h old
2542
+ Ġav oid
2543
+ Ġgl obal
2544
+ Ġun its
2545
+ y l
2546
+ Ġf all
2547
+ ] ]
2548
+ Ġproper ties
2549
+ 4 9
2550
+ Ġf it
2551
+ Ġcompon ents
2552
+ Ġbehav ior
2553
+ Ġal tern
2554
+ 6 5
2555
+ Ġass ess
2556
+ Ġinst ance
2557
+ Ġmax imum
2558
+ Ġ %
2559
+ Ġro w
2560
+ p ose
2561
+ Ġg as
2562
+ uc k
2563
+ Ġsh ape
2564
+ Ġmom ent
2565
+ Ġbas ic
2566
+ ell ing
2567
+ te x
2568
+ st ruct
2569
+ ful ly
2570
+ Ġ6 0
2571
+ Ġd oc
2572
+ Ġ ?
2573
+ g ing
2574
+ Ġre d
2575
+ Ġhow ever
2576
+ Ġref lect
2577
+ Ġt akes
2578
+ ĠC ons
2579
+ Ġh arm
2580
+ Ġp air
2581
+ Ġspec ies
2582
+ d a
2583
+ od es
2584
+ op y
2585
+ Ġh alf
2586
+ Ġresp onse
2587
+ Ġvel ocity
2588
+ Ġm oney
2589
+ Ġco e
2590
+ O ne
2591
+ Ġthough t
2592
+ Ġet c
2593
+ b egin
2594
+ Ġdi ag
2595
+ Ġwrit ten
2596
+ Ġinter act
2597
+ z z
2598
+ Ġc os
2599
+ Ġdy nam
2600
+ is on
2601
+ Ġcap ac
2602
+ Ġte ac
2603
+ 3 1
2604
+ m ost
2605
+ Ġent ire
2606
+ g o
2607
+ o res
2608
+ ĠN ow
2609
+ ĠWh ile
2610
+ Ġnet work
2611
+ Ġtrain ing
2612
+ Ġab ility
2613
+ Ġbuild ing
2614
+ Ġs ays
2615
+ Ġ- >
2616
+ ĠH ere
2617
+ Ġev ents
2618
+ t age
2619
+ alle l
2620
+ Ġpr int
2621
+ Ġsu st
2622
+ Ġdo ing
2623
+ Ġcomp any
2624
+ Ġc ross
2625
+ uro pe
2626
+ 7 7
2627
+ Ġ\ \
2628
+ Ġit em
2629
+ ur s
2630
+ ĠM ed
2631
+ t r
2632
+ th on
2633
+ Ġval u
2634
+ ĠY our
2635
+ Ġb ar
2636
+ Ġh or
2637
+ Ġw ar
2638
+ ost s
2639
+ ri or
2640
+ Ġincre ased
2641
+ w ay
2642
+ Ġph ot
2643
+ v ant
2644
+ I T
2645
+ Ġcre ating
2646
+ um ents
2647
+ Ġaut hor
2648
+ Ġdec re
2649
+ ' m
2650
+ Ġn ut
2651
+ I m
2652
+ ac ed
2653
+ Ġprovid ed
2654
+ Ġelect ric
2655
+ in ally
2656
+ Ġme et
2657
+ im als
2658
+ Ġdem onstr
2659
+ Ġex c
2660
+ Ġtrad itional
2661
+ Ġit self
2662
+ re ci
2663
+ Ġw ide
2664
+ rodu ction
2665
+ I D
2666
+ Ġst ates
2667
+ Ġbenef its
2668
+ ill ed
2669
+ Ġexam ples
2670
+ ar row
2671
+ Ġsust ain
2672
+ Ġoff er
2673
+ a res
2674
+ it es
2675
+ pt oms
2676
+ or por
2677
+ Ġcomput er
2678
+ Ġthe ra
2679
+ Ġst e
2680
+ sy ch
2681
+ Ġexperi ences
2682
+ re en
2683
+ Ġpract ices
2684
+ Ġ2 2
2685
+ ove red
2686
+ ail y
2687
+ Ġmat ter
2688
+ it or
2689
+ Ġm ess
2690
+ w o
2691
+ ord er
2692
+ or g
2693
+ p oint
2694
+ Ġstud ent
2695
+ A S
2696
+ Ġgovern ment
2697
+ ĠC ent
2698
+ Ġexact ly
2699
+ se c
2700
+ ĠN ot
2701
+ d ef
2702
+ b on
2703
+ Ġst ra
2704
+ Ġfe ed
2705
+ Ġinter n
2706
+ Ġfollow s
2707
+ Ġsh ap
2708
+ em ic
2709
+ iz es
2710
+ ct ors
2711
+ Ġl ooking
2712
+ mathb f
2713
+ plic ation
2714
+ Ġfam il
2715
+ Ġy et
2716
+ Ġt aken
2717
+ Ġv ide
2718
+ Ġsm o
2719
+ Ġ vert
2720
+ Ġm en
2721
+ Ġstrateg ies
2722
+ Ġal gebra
2723
+ Ġf rame
2724
+ re es
2725
+ Ġth ing
2726
+ Ġbec omes
2727
+ 6 4
2728
+ ĠF rom
2729
+ et er
2730
+ Ġrequ ires
2731
+ r ont
2732
+ ast e
2733
+ ĠU se
2734
+ âĶ ¼
2735
+ ĠD ec
2736
+ Ġc m
2737
+ is ions
2738
+ Ġm icro
2739
+ Ġsequ ence
2740
+ I S
2741
+ ĠA pp
2742
+ ĠM ar
2743
+ the ta
2744
+ ĠE urope
2745
+ n ed
2746
+ ĠS ystem
2747
+ c ol
2748
+ Ġappro pri
2749
+ Ġpop ular
2750
+ er ve
2751
+ 8 5
2752
+ Ġdig ital
2753
+ Ġparamet ers
2754
+ Ġl ink
2755
+ Ġcount ry
2756
+ ĠS he
2757
+ ĠRe g
2758
+ Ġa im
2759
+ Ġrec omm
2760
+ l im
2761
+ ĠEar th
2762
+ ol es
2763
+ C om
2764
+ n omial
2765
+ Ġpl ants
2766
+ Ġlar ger
2767
+ Ġad apt
2768
+ Ġ2 3
2769
+ b ack
2770
+ l o
2771
+ Ġcre ated
2772
+ w ers
2773
+ ĠTr ans
2774
+ Ġopt im
2775
+ h ood
2776
+ Ġem p
2777
+ Ġins ide
2778
+ Ġa ction
2779
+ ra ft
2780
+ 9 7
2781
+ il t
2782
+ Ġco ordin
2783
+ Ġâ ī
2784
+ ĠC O
2785
+ Ġcon duct
2786
+ ĠA fter
2787
+ Ġf ive
2788
+ ĠA m
2789
+ ĠUn ited
2790
+ al pha
2791
+ rou p
2792
+ B y
2793
+ end er
2794
+ Ġs ometimes
2795
+ op h
2796
+ Ġcomp et
2797
+ av ing
2798
+ g s
2799
+ os ing
2800
+ is f
2801
+ Ġdesign ed
2802
+ av or
2803
+ S tep
2804
+ Ġgu id
2805
+ Ġfin ancial
2806
+ L E
2807
+ ] )
2808
+ Ġenc oura
2809
+ Ġmed ical
2810
+ Ġrese arc
2811
+ ust r
2812
+ Ġreg ion
2813
+ $ \
2814
+ Ġan n
2815
+ Ġsim pl
2816
+ ign ed
2817
+ Ġevery one
2818
+ I ON
2819
+ Ġf inal
2820
+ ot al
2821
+ Ġprodu ce
2822
+ Ġel se
2823
+ Ġsaf e
2824
+ R E
2825
+ ĠAn al
2826
+ AA AA
2827
+ Ġobject s
2828
+ Ġw ave
2829
+ Ġmem bers
2830
+ omet ry
2831
+ Ġuse ful
2832
+ ter ns
2833
+ Ġvis ual
2834
+ Ġre view
2835
+ Ġem erg
2836
+ o on
2837
+ Ġfe atures
2838
+ Ġcult ural
2839
+ Ġprocess es
2840
+ Ġread ing
2841
+ r ical
2842
+ Ġ2 8
2843
+ oun ter
2844
+ Ġcont ains
2845
+ Ġbl ock
2846
+ Ġf ace
2847
+ Ġg ot
2848
+ ble m
2849
+ Ġcomp ared
2850
+ Ġin nov
2851
+ ĠCom m
2852
+ Ġon es
2853
+ le ep
2854
+ nderstand ing
2855
+ } ^
2856
+ Ġ ]
2857
+ Ġlead ing
2858
+ Ġfri ends
2859
+ Ġs in
2860
+ ĠG e
2861
+ as c
2862
+ Ġapp ly
2863
+ Ġst op
2864
+ Ġserv ices
2865
+ Ġre v
2866
+ plic ations
2867
+ Ġcommun ication
2868
+ Ġhe ight
2869
+ Ġag o
2870
+ Ġrem ember
2871
+ Ġp age
2872
+ a ult
2873
+ ĠSt ates
2874
+ Ġw a
2875
+ y pe
2876
+ e le
2877
+ Ġd at
2878
+ Ġcommun ities
2879
+ Ġp ack
2880
+ Ġap plied
2881
+ re am
2882
+ Ġwee k
2883
+ Ġcount ries
2884
+ Ġenvironment al
2885
+ ' ve
2886
+ - \
2887
+ Ġsign al
2888
+ ĠR ep
2889
+ Ġdevelop ed
2890
+ ĠA f
2891
+ Ġthem selves
2892
+ it ation
2893
+ or th
2894
+ j oy
2895
+ it ch
2896
+ Ġpat terns
2897
+ Ġequ ival
2898
+ rac y
2899
+ ar ray
2900
+ Ã Ĺ
2901
+ m ore
2902
+ Ġdep end
2903
+ il s
2904
+ ĠC o
2905
+ Ġsaf ety
2906
+ Ġpro pos
2907
+ t ic
2908
+ Ġpro ced
2909
+ Ï Ģ
2910
+ Ġfor ms
2911
+ Ġconst ruct
2912
+ Ġr ule
2913
+ Ġcle an
2914
+ ĠR ec
2915
+ Ġj ob
2916
+ idd le
2917
+ Ġapplic ation
2918
+ Ġyour self
2919
+ Ġu r
2920
+ y p
2921
+ Ġaut om
2922
+ Ġsym ptoms
2923
+ Ġpl ot
2924
+ Ġev idence
2925
+ Ġexp ect
2926
+ Ġs ides
2927
+ Ġeffic ient
2928
+ g round
2929
+ Ġ2 6
2930
+ olog ies
2931
+ Ġch oose
2932
+ Ġs low
2933
+ wor ks
2934
+ Ġus er
2935
+ Ġca pt
2936
+ u fact
2937
+ Ġc ub
2938
+ , \
2939
+ ĠÂłĠÂł ĠÂłĠÂł
2940
+ ce ed
2941
+ ab ilities
2942
+ Ġhealth y
2943
+ Ġ2 7
2944
+ Ġwrit ing
2945
+ o k
2946
+ Ġs ent
2947
+ Ġparticular ly
2948
+ Ġsmall er
2949
+ Ġmin utes
2950
+ 5 6
2951
+ y ond
2952
+ o ly
2953
+ ĠCom p
2954
+ ac ks
2955
+ Ġder iv
2956
+ Ġsc ale
2957
+ h ib
2958
+ iz ations
2959
+ Ġcontin ue
2960
+ Ġvol tage
2961
+ ar ily
2962
+ Ġinclud es
2963
+ ic les
2964
+ b da
2965
+ pr int
2966
+ Ġse arch
2967
+ Ġacc ur
2968
+ Ġproper ty
2969
+ ĠS ince
2970
+ Ġcirc le
2971
+ Ġinvol ves
2972
+ Ġsub st
2973
+ i ol
2974
+ n ers
2975
+ st ry
2976
+ } (
2977
+ Ġeas ily
2978
+ ĠĠĠĠĠĠĠĠ ĠĠĠ
2979
+ Ġcult ure
2980
+ ĠA I
2981
+ ter m
2982
+ Ġapp reci
2983
+ Ġsoft ware
2984
+ Ġper fect
2985
+ Ġt ree
2986
+ Ġtri angle
2987
+ Ġwee ks
2988
+ al se
2989
+ Ġl ives
2990
+ os is
2991
+ ĠIn tern
2992
+ Ġadd itional
2993
+ pp er
2994
+ c are
2995
+ âĶģâĶģ âĶģâĶģ
2996
+ Ġcan cer
2997
+ ĠG u
2998
+ Ġth us
2999
+ Ġcontinu ous
3000
+ ag ed
3001
+ Ġac cept
3002
+ B ut
3003
+ Ġ --
3004
+ Ġdec ision
3005
+ Ġinter p
3006
+ C l
3007
+ Ã ©
3008
+ ĠP art
3009
+ ig ma
3010
+ Ġimport ance
3011
+ ĠA ct
3012
+ Ġl ove
3013
+ ens ion
3014
+ Ġachie ve
3015
+ Ġl ive
3016
+ ir m
3017
+ Ġdirect ly
3018
+ l oad
3019
+ Ġb ox
3020
+ ĠCh rist
3021
+ res ents
3022
+ Ġset s
3023
+ Ġth ird
3024
+ r ig
3025
+ ect or
3026
+ Ġhy d
3027
+ Ġp rior
3028
+ in ite
3029
+ Ġm ental
3030
+ e ed
3031
+ in ct
3032
+ Ġlong er
3033
+ Ġcirc uit
3034
+ Ġl iving
3035
+ Ġres istance
3036
+ ition ally
3037
+ Ġinvest ig
3038
+ Ġar ch
3039
+ Ġf ost
3040
+ ce ll
3041
+ Ġs ound
3042
+ au gh
3043
+ Ġget ting
3044
+ Ġis n
3045
+ A B
3046
+ Ġ ir
3047
+ Ġr ules
3048
+ A M
3049
+ Ġs al
3050
+ Ġfl o
3051
+ Ġp ict
3052
+ Ġmach ine
3053
+ ri ption
3054
+ Ġatt ention
3055
+ ĠD ata
3056
+ p ite
3057
+ Ġcl imate
3058
+ t imes
3059
+ Ġtry ing
3060
+ Ġc ateg
3061
+ ( "
3062
+ Ġmus ic
3063
+ Ġappropri ate
3064
+ ve y
3065
+ E D
3066
+ Ġh ouse
3067
+ Ġc ard
3068
+ Ġmot ion
3069
+ Ġsp read
3070
+ l og
3071
+ ad r
3072
+ Ġsk in
3073
+ Ġprovid ing
3074
+ Ġd ensity
3075
+ el ta
3076
+ ĠP M
3077
+ Ġcont act
3078
+ Ġcost s
3079
+ Ġdeg ree
3080
+ Ġadd ed
3081
+ Ġ _
3082
+ Ġcon cent
3083
+ ĠS ub
3084
+ ĠA b
3085
+ 4 3
3086
+ ĠU sing
3087
+ Ġcent er
3088
+ 0 6
3089
+ Ġw ond
3090
+ Ġa ud
3091
+ Ġï Ģ
3092
+ du c
3093
+ ac c
3094
+ in ating
3095
+ ðĿ IJ
3096
+ Ġen joy
3097
+ ĠF r
3098
+ re me
3099
+ Ġmonth s
3100
+ Ġcl aim
3101
+ ul ate
3102
+ enc ies
3103
+ Ġbal ance
3104
+ Ġsat isf
3105
+ ĠThere fore
3106
+ Ġsoci ety
3107
+ pe c
3108
+ ol ar
3109
+ Ġs ources
3110
+ ĠâĢ ¦
3111
+ Ġcur ve
3112
+ n a
3113
+ cd ot
3114
+ 4 2
3115
+ he l
3116
+ Ġpro te
3117
+ ib r
3118
+ Ġm or
3119
+ Ġbeh ind
3120
+ ĠTh us
3121
+ x i
3122
+ Ġth inking
3123
+ en ed
3124
+ Ġoper ations
3125
+ Ġst ories
3126
+ ere nces
3127
+ H ere
3128
+ C T
3129
+ Ġac cel
3130
+ Ġexp ected
3131
+ Ġvalu able
3132
+ 8 6
3133
+ ĠA p
3134
+ hes is
3135
+ Ġindu stry
3136
+ Ġthere fore
3137
+ m od
3138
+ p id
3139
+ Ġsignificant ly
3140
+ R O
3141
+ ĠâĨ Ĵ
3142
+ Ġ201 0
3143
+ ĠTe chn
3144
+ Ġd aily
3145
+ ult s
3146
+ Ġpar allel
3147
+ at t
3148
+ Ġrel ig
3149
+ Ġrep resents
3150
+ ĠIn te
3151
+ Ġv ia
3152
+ Ġ$ {\
3153
+ Ġstreng th
3154
+ ec ause
3155
+ Ġqu ite
3156
+ Ġm ole
3157
+ g ers
3158
+ ĠE ach
3159
+ s ub
3160
+ Ġide as
3161
+ Ġ {\
3162
+ ĠD r
3163
+ Ġext ra
3164
+ ĠS ec
3165
+ ur b
3166
+ ure d
3167
+ Ġeconom ic
3168
+ it able
3169
+ Ġw al
3170
+ ĠA re
3171
+ Ġsu n
3172
+ ron ic
3173
+ Ġfe et
3174
+ ic ial
3175
+ f ort
3176
+ Ġopportun ities
3177
+ ĠP y
3178
+ ĠF irst
3179
+ ĠG o
3180
+ ra nd
3181
+ Ġsur round
3182
+ Ġmeas ures
3183
+ Ġpr iv
3184
+ Ġinvol ved
3185
+ Ġin form
3186
+ c ient
3187
+ an cing
3188
+ ns wer
3189
+ Ġbl ack
3190
+ Ġmov ing
3191
+ x y
3192
+ Ġbe yond
3193
+ Ġde b
3194
+ Ġmill ion
3195
+ ĠA cc
3196
+ le ar
3197
+ Ġ201 2
3198
+ Ġhistor ical
3199
+ ĠHe alth
3200
+ Ġind ex
3201
+ ĠC ar
3202
+ Ġcalcul ated
3203
+ Ġconcept s
3204
+ Ġ version
3205
+ por ary
3206
+ Ġs ite
3207
+ Ġor d
3208
+ Ġ= =
3209
+ ra w
3210
+ Ġf ile
3211
+ un g
3212
+ ĠIn ter
3213
+ Ġprog ress
3214
+ Ġf u
3215
+ id ed
3216
+ d o
3217
+ r ite
3218
+ Ġadj ust
3219
+ Ġdefin ition
3220
+ Ġout side
3221
+ ĠAf ric
3222
+ is ms
3223
+ Ġaw are
3224
+ omet ric
3225
+ Ġstart ed
3226
+ m ber
3227
+ ĠPh ys
3228
+ ow s
3229
+ Ġf ul
3230
+ Ġc at
3231
+ c hed
3232
+ ith ms
3233
+ E T
3234
+ Ġcolum n
3235
+ Ġtyp ically
3236
+ ir ing
3237
+ Ġobtain ed
3238
+ l er
3239
+ i os
3240
+ ri ed
3241
+ at form
3242
+ Ġprom ot
3243
+ 0 8
3244
+ av ig
3245
+ Ġm iss
3246
+ Ġopt ions
3247
+ Ġpro of
3248
+ ens ive
3249
+ Ġ @
3250
+ ĠEng lish
3251
+ ĠL ear
3252
+ Ġrelationship s
3253
+ Ġresearc hers
3254
+ Ġco ol
3255
+ Ġst ay
3256
+ oc ks
3257
+ ĠT est
3258
+ ĠSc ience
3259
+ Ġbr ing
3260
+ Ġright s
3261
+ Ġ vers
3262
+ Ġwh ose
3263
+ : :
3264
+ Ġindepend ent
3265
+ Ġ201 1
3266
+ ĠTh rough
3267
+ Ġu nd
3268
+ Ġpoly nomial
3269
+ U n
3270
+ Ġwe bs
3271
+ Ġl if
3272
+ Ġe th
3273
+ Ġ ^
3274
+ Ġr ates
3275
+ m ar
3276
+ Ġcomp an
3277
+ a i
3278
+ 0 2
3279
+ ĠP ar
3280
+ Ġoff ers
3281
+ ## ###
3282
+ Ġf ast
3283
+ Ġwr ong
3284
+ ĠR em
3285
+ id th
3286
+ Ġprim ary
3287
+ re ct
3288
+ Ġph ase
3289
+ ĠF orm
3290
+ Ġmed ia
3291
+ O n
3292
+ Ġrem ov
3293
+ Ġro b
3294
+ Ġman ufact
3295
+ Ġchem ical
3296
+ Ġso il
3297
+ Ġpr ime
3298
+ Ġ201 3
3299
+ Ġbas is
3300
+ 5 7
3301
+ Ġpers pect
3302
+ Ġt ax
3303
+ Ġmin im
3304
+ m b
3305
+ am in
3306
+ Ġcent ury
3307
+ ĠG od
3308
+ Ġiss ue
3309
+ Ġc ou
3310
+ Ġquick ly
3311
+ Ġgre en
3312
+ Ġbe aut
3313
+ Ġstra ight
3314
+ ĠA M
3315
+ ut h
3316
+ N A
3317
+ il es
3318
+ Ġdem and
3319
+ Ġan imals
3320
+ 5 8
3321
+ Ġins p
3322
+ Ġmathemat ical
3323
+ Ġf ixed
3324
+ Ġl ands
3325
+ Ġsp ir
3326
+ Ġhy pot
3327
+ Ġevery thing
3328
+ tem pt
3329
+ b eta
3330
+ Ġwh ite
3331
+ 0 4
3332
+ Ġmed ic
3333
+ _ {\
3334
+ Ġinc orpor
3335
+ Ġ Ð
3336
+ 6 7
3337
+ Ġdi et
3338
+ ĠM y
3339
+ ( -
3340
+ Ġnot e
3341
+ + +
3342
+ Ġplan e
3343
+ ww w
3344
+ Ġpat ient
3345
+ S h
3346
+ i ar
3347
+ Ġbro ad
3348
+ ac hed
3349
+ A nd
3350
+ Ġdescrib ed
3351
+ u ly
3352
+ en ced
3353
+ he ns
3354
+ ĠCl ass
3355
+ Ġdam age
3356
+ Ġre act
3357
+ ou d
3358
+ Ġs ix
3359
+ Ġsec urity
3360
+ l i
3361
+ ĠJ an
3362
+ Ġjour ney
3363
+ Ġmult ip
3364
+ + \
3365
+ st er
3366
+ Ġs leep
3367
+ ĠJ oh
3368
+ o ined
3369
+ il it
3370
+ ff ect
3371
+ Ġinflu ence
3372
+ Ġdoc ument
3373
+ ________ ________
3374
+ Ġcoll abor
3375
+ Ġpolit ical
3376
+ Ġd ru
3377
+ erv ation
3378
+ ĠN ational
3379
+ Ġdev ices
3380
+ ĠS ch
3381
+ he et
3382
+ Ġd og
3383
+ Ġd ouble
3384
+ op s
3385
+ ĠM ult
3386
+ ubl ic
3387
+ Ġconn ected
3388
+ Ġdi agn
3389
+ Ġident ity
3390
+ Ġre ve
3391
+ ĠWor ld
3392
+ om an
3393
+ Ġp sych
3394
+ Ġw all
3395
+ Ġcomp ar
3396
+ m ission
3397
+ Ġadv ant
3398
+ m y
3399
+ Ġprog rams
3400
+ er al
3401
+ Ġpro port
3402
+ ect ions
3403
+ Ġde ath
3404
+ ur ation
3405
+ Ġco ver
3406
+ Ġparamet er
3407
+ Ġvide o
3408
+ Ġaspect s
3409
+ Ġfor ces
3410
+ Ġdi verse
3411
+ 9 4
3412
+ Ġserv ice
3413
+ ĠA c
3414
+ Ġ200 9
3415
+ mathb b
3416
+ " .
3417
+ Ġch apter
3418
+ ĠRes earch
3419
+ Ġstate ment
3420
+ Ġinte ger
3421
+ Ġal most
3422
+ g est
3423
+ Ġhe av
3424
+ en n
3425
+ Ġincre ases
3426
+ Ġmove ment
3427
+ Ġdeg rees
3428
+ Ġ\ (\
3429
+ Ġup d
3430
+ o ff
3431
+ ĠD ef
3432
+ ĠSt ate
3433
+ Ġcontrib ute
3434
+ Ġeffic iency
3435
+ ograph y
3436
+ A P
3437
+ Ġrem ains
3438
+ Ġf oot
3439
+ Ġpre p
3440
+ Ġfind ing
3441
+ w ith
3442
+ ĠMat hemat
3443
+ Ġc ity
3444
+ Ġcorrespond ing
3445
+ com es
3446
+ Ġrec ent
3447
+ Ġd est
3448
+ ĠĠĠĠĠĠĠĠ Ġ
3449
+ Ch apter
3450
+ 0 7
3451
+ he ad
3452
+ Ġh ab
3453
+ Ġf raction
3454
+ Ġpower ful
3455
+ 9 3
3456
+ Ġm ention
3457
+ 0 3
3458
+ 6 8
3459
+ Ġ er
3460
+ ĠâĪ Ī
3461
+ ract ions
3462
+ Ġstruct ures
3463
+ Ġval id
3464
+ a e
3465
+ Ġmem ory
3466
+ Ġus ers
3467
+ r s
3468
+ im in
3469
+ Ġb ott
3470
+ ur rent
3471
+ d om
3472
+ Ġbec ame
3473
+ m u
3474
+ ĠD i
3475
+ Ġre ach
3476
+ Ġstart ing
3477
+ Ġmin imum
3478
+ Ġcho ice
3479
+ 4 1
3480
+ Ġtest s
3481
+ Ġf at
3482
+ Ġsub t
3483
+ Ġact ual
3484
+ Ġdiffere nces
3485
+ ĠA N
3486
+ if ically
3487
+ ch ing
3488
+ Ġseem s
3489
+ ĠJ ust
3490
+ ere nt
3491
+ Ġdis play
3492
+ Ġcomp re
3493
+ ify ing
3494
+ ĠA g
3495
+ ĠM on
3496
+ Ġcompon ent
3497
+ os ure
3498
+ Ġdef ine
3499
+ Ġexpl oring
3500
+ Ġequival ent
3501
+ Ġo dd
3502
+ ve re
3503
+ ĠSu pp
3504
+ ph as
3505
+ ```` ``
3506
+ E M
3507
+ Ġdev ice
3508
+ Ġp an
3509
+ Ġref erence
3510
+ Ġ200 8
3511
+ Ġas k
3512
+ am ma
3513
+ Ġy ield
3514
+ Ġcont roll
3515
+ Ġut il
3516
+ ul ated
3517
+ ĠEx pl
3518
+ Ġref er
3519
+ u ff
3520
+ Ġgra v
3521
+ Ġcon c
3522
+ ĠG ener
3523
+ part ial
3524
+ os ite
3525
+ ĠF igure
3526
+ Ġpl atform
3527
+ Ġl a
3528
+ ĠE d
3529
+ t ical
3530
+ }} \
3531
+ Ġim ages
3532
+ ĠO ct
3533
+ b ig
3534
+ Ġcaus es
3535
+ Ex ample
3536
+ Ġbelie ve
3537
+ on ic
3538
+ Ġse x
3539
+ Ġo il
3540
+ ĠO f
3541
+ Ġre pe
3542
+ Ġ9 0
3543
+ h ing
3544
+ S ection
3545
+ Ġc ame
3546
+ Ġsitu ation
3547
+ our se
3548
+ Ġk g
3549
+ et erm
3550
+ qu e
3551
+ ĠS ep
3552
+ ĠO ver
3553
+ ] [
3554
+ og le
3555
+ Ġu lt
3556
+ ol ute
3557
+ A t
3558
+ se e
3559
+ Ġres id
3560
+ Ġb ooks
3561
+ b ook
3562
+ Ġbu y
3563
+ Ġinterest ing
3564
+ Ġgener ally
3565
+ P S
3566
+ Ġtest ing
3567
+ Ġintegr al
3568
+ Ġexp on
3569
+ Ġsupp ly
3570
+ ĠV al
3571
+ Ġm ap
3572
+ le y
3573
+ Ġ2 9
3574
+ amet er
3575
+ Ġcomm it
3576
+ ol ic
3577
+ ish ing
3578
+ Ġeffect ively
3579
+ Ġeff orts
3580
+ Ġchar ge
3581
+ ell ig
3582
+ I V
3583
+ Ġ ;
3584
+ ro te
3585
+ Ġthe orem
3586
+ Ġst ru
3587
+ ĠD ep
3588
+ F igure
3589
+ ed s
3590
+ Ġfund am
3591
+ s u
3592
+ Ġinter val
3593
+ Ġgo es
3594
+ Ġopt ion
3595
+ ĠEx ample
3596
+ tern al
3597
+ Ġvari ety
3598
+ Ġdetail s
3599
+ Ġs ort
3600
+ Ġsp ect
3601
+ um b
3602
+ Ġest imate
3603
+ Ġans wers
3604
+ Ġhor iz
3605
+ Ġexperim ent
3606
+ Ġ$ {
3607
+ am s
3608
+ ĠM in
3609
+ Ġsur v
3610
+ O T
3611
+ ph i
3612
+ ane ous
3613
+ ed u
3614
+ Ġext reme
3615
+ Ġre ct
3616
+ c he
3617
+ Ġat tempt
3618
+ b re
3619
+ Ġresult ing
3620
+ Ġitem s
3621
+ pl ing
3622
+ iv il
3623
+ Ġgo al
3624
+ lam bda
3625
+ an ation
3626
+ Ġins ights
3627
+ m m
3628
+ Ġens uring
3629
+ it le
3630
+ Ġdevelop ing
3631
+ g ment
3632
+ l or
3633
+ know n
3634
+ Ġexerc ise
3635
+ U S
3636
+ ĠIn st
3637
+ }} {
3638
+ art ment
3639
+ ĠR el
3640
+ ag s
3641
+ Ġoper ation
3642
+ 0 9
3643
+ Ġ ~
3644
+ or k
3645
+ est ions
3646
+ Ġb ond
3647
+ orm al
3648
+ ĠM any
3649
+ ĠA rt
3650
+ Ġtrans fer
3651
+ Ġinst all
3652
+ Ġex cept
3653
+ le ge
3654
+ od ies
3655
+ Ġin j
3656
+ Ġill ustr
3657
+ Ġcar bon
3658
+ Ġear th
3659
+ Ġf asc
3660
+ ĠCom put
3661
+ Ġm is
3662
+ Ġfield s
3663
+ D E
3664
+ l ict
3665
+ Ġ/ /
3666
+ f erence
3667
+ m ax
3668
+ Ġloc ation
3669
+ Ġallow ing
3670
+ Ġstr ing
3671
+ line ar
3672
+ g ram
3673
+ ĠP e
3674
+ Ġw in
3675
+ igh b
3676
+ ĠI I
3677
+ i able
3678
+ wh ich
3679
+ Ġdist inct
3680
+ Ġenh ance
3681
+ Ġpat tern
3682
+ a ff
3683
+ ĠH ist
3684
+ ip ment
3685
+ Ġredu ced
3686
+ Ġsc en
3687
+ Ġve h
3688
+ op t
3689
+ Ġear l
3690
+ Ġax is
3691
+ } )
3692
+ ( (
3693
+ ] ;
3694
+ es e
3695
+ Ġrespect ively
3696
+ Â ²
3697
+ am ed
3698
+ w ord
3699
+ ra int
3700
+ ĠA B
3701
+ Ġfor ward
3702
+ om in
3703
+ Ġscient ific
3704
+ Ġgrow ing
3705
+ Ġsol id
3706
+ u racy
3707
+ os ition
3708
+ ch ange
3709
+ ro om
3710
+ ĠN umber
3711
+ val ue
3712
+ Ġout comes
3713
+ Qu estion
3714
+ Ġprinci ples
3715
+ as ons
3716
+ ! !
3717
+ Ġ3 5
3718
+ ĠN um
3719
+ Ġinclud ed
3720
+ ........ ........
3721
+ Ġrad ius
3722
+ Ġtoo k
3723
+ o ber
3724
+ stit ute
3725
+ Ġ Ċ
3726
+ ĠO ur
3727
+ Ġag ree
3728
+ od ay
3729
+ o very
3730
+ Ġtre nd
3731
+ Ġlay er
3732
+ Ġsol ving
3733
+ Ġ< -
3734
+ Ġcre d
3735
+ ĠW ar
3736
+ 8 7
3737
+ Ġact ive
3738
+ Ġaltern ative
3739
+ if orm
3740
+ Ġcaus ed
3741
+ ĠA ug
3742
+ Ġcapac ity
3743
+ I s
3744
+ Ġn avig
3745
+ ri er
3746
+ ĠC he
3747
+ ĠC re
3748
+ Ġtrans port
3749
+ Ġparent s
3750
+ Ġf em
3751
+ Ġlim ited
3752
+ Ġeas ier
3753
+ tem porary
3754
+ Ġbu ilt
3755
+ row n
3756
+ Ġf air
3757
+ Ġpur pose
3758
+ Ġcompan ies
3759
+ act ers
3760
+ v est
3761
+ Ġang les
3762
+ ĠI N
3763
+ Ġfri end
3764
+ Ġprofess ional
3765
+ ĠF urther
3766
+ Ġ4 5
3767
+ Ġb ur
3768
+ el low
3769
+ i ber
3770
+ ist ry
3771
+ Ġhealth care
3772
+ an cy
3773
+ Ġli qu
3774
+ ĠC al
3775
+ I nt
3776
+ Ġtr ig
3777
+ Ġimm edi
3778
+ Ġprob ably
3779
+ or ation
3780
+ ĠLe vel
3781
+ Ġas ked
3782
+ c ast
3783
+ ut or
3784
+ Ġv ary
3785
+ Ġr out
3786
+ Ġpie ce
3787
+ h a
3788
+ ill ing
3789
+ Ġany thing
3790
+ Ġrele vant
3791
+ ĠO ther
3792
+ W ith
3793
+ or rect
3794
+ Ġth reat
3795
+ Ġ201 6
3796
+ Ġobserv ed
3797
+ ĠA pr
3798
+ ĠU nderstanding
3799
+ Ġmeasure ment
3800
+ ĠT H
3801
+ id ge
3802
+ Ġindu str
3803
+ l s
3804
+ h aps
3805
+ ol ve
3806
+ c ont
3807
+ Ġprodu ced
3808
+ in ks
3809
+ F rom
3810
+ Ġn ational
3811
+ d x
3812
+ Ġdec isions
3813
+ Ġadd ing
3814
+ ĠW ell
3815
+ Ġcon vert
3816
+ ---------------- ----------------
3817
+ Ġregard ing
3818
+ Ġcalcul ator
3819
+ Ġed ge
3820
+ Ġcalcul ation
3821
+ 8 9
3822
+ u zz
3823
+ Ġappro aches
3824
+ Ġfin ite
3825
+ it ect
3826
+ Ġg ames
3827
+ ĠL ine
3828
+ r or
3829
+ Ġl ed
3830
+ Ġproject s
3831
+ Ġsu ff
3832
+ Ġhum ans
3833
+ Ġem phas
3834
+ Ġ201 5
3835
+ Ġ201 4
3836
+ ĠO ut
model.py ADDED
@@ -0,0 +1,288 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ import math
2
+ from typing import Optional
3
+
4
+ import torch
5
+ import torch.nn as nn
6
+ from torch import Tensor
7
+ from torch.nn import functional as F
8
+ from transformers import PreTrainedModel
9
+ from transformers.cache_utils import DynamicCache
10
+ from transformers.generation.utils import GenerationMixin
11
+ from transformers.modeling_outputs import CausalLMOutputWithPast
12
+
13
+ from .config import GPTConfig
14
+
15
+
16
+ CONTROL_TENSOR_NAME_PATTERNS = (
17
+ "scale",
18
+ "gate",
19
+ "gain",
20
+ "norm",
21
+ "ln_",
22
+ "rms",
23
+ )
24
+
25
+
26
+ class CastedLinear(nn.Linear):
27
+ """Store linear params in FP32, cast to activation dtype for matmul."""
28
+
29
+ def forward(self, x: Tensor) -> Tensor:
30
+ weight = self.weight.to(dtype=x.dtype)
31
+ bias = self.bias.to(dtype=x.dtype) if self.bias is not None else None
32
+ return F.linear(x, weight, bias)
33
+
34
+
35
+ def restore_fp32_params(model: nn.Module) -> None:
36
+ """Keep linear weights and control params in FP32 after dtype conversion."""
37
+ for module in model.modules():
38
+ if isinstance(module, CastedLinear):
39
+ module.float()
40
+ for name, param in model.named_parameters():
41
+ if (
42
+ param.ndim < 2
43
+ or any(pattern in name for pattern in CONTROL_TENSOR_NAME_PATTERNS)
44
+ ) and param.dtype != torch.float32:
45
+ param.data = param.data.float()
46
+
47
+
48
+ class RMSNorm(nn.Module):
49
+ def __init__(self, dim, eps=1e-6):
50
+ super().__init__()
51
+ self.eps = eps
52
+ self.weight = nn.Parameter(torch.ones(dim))
53
+
54
+ def forward(self, x):
55
+ rms = torch.rsqrt(x.float().pow(2).mean(-1, keepdim=True) + self.eps)
56
+ return (x.float() * rms).to(dtype=x.dtype) * self.weight.to(dtype=x.dtype)
57
+
58
+
59
+ def build_rope_inv_freq(head_dim, theta=2500.0):
60
+ return 1.0 / (theta ** (torch.arange(0, head_dim, 2, dtype=torch.float32) / head_dim))
61
+
62
+
63
+ def precompute_rope_cos_sin(head_dim, seq_len, theta=2500.0):
64
+ freqs = build_rope_inv_freq(head_dim, theta)
65
+ t = torch.arange(seq_len, dtype=torch.float32)
66
+ freqs = torch.outer(t, freqs)
67
+ return freqs.cos(), freqs.sin()
68
+
69
+
70
+ def _apply_rope(x, cos, sin):
71
+ x_float = x.float()
72
+ x_pair = x_float.reshape(*x_float.shape[:-1], -1, 2)
73
+ even = x_pair[..., 0]
74
+ odd = x_pair[..., 1]
75
+ cos = cos.unsqueeze(0).unsqueeze(0)
76
+ sin = sin.unsqueeze(0).unsqueeze(0)
77
+ x_rot = torch.stack((even * cos - odd * sin, even * sin + odd * cos), dim=-1)
78
+ return x_rot.flatten(-2).type_as(x)
79
+
80
+
81
+ def apply_rotary_emb(q, k, freqs_cis):
82
+ cos, sin = freqs_cis
83
+ return _apply_rope(q, cos, sin), _apply_rope(k, cos, sin)
84
+
85
+ class GPTAttention(nn.Module):
86
+ def __init__(self, config, layer_idx):
87
+ super().__init__()
88
+ self.layer_idx = layer_idx
89
+ self.n_head = config.num_attention_heads
90
+ self.n_kv_heads = config.num_key_value_heads
91
+ self.head_dim = config.head_dim
92
+ self.n_rep = self.n_head // self.n_kv_heads
93
+ self.xsa_projection = config.xsa_projection
94
+
95
+ self.q_proj = CastedLinear(config.hidden_size, self.n_head * self.head_dim, bias=False)
96
+ self.k_proj = CastedLinear(config.hidden_size, self.n_kv_heads * self.head_dim, bias=False)
97
+ self.v_proj = CastedLinear(config.hidden_size, self.n_kv_heads * self.head_dim, bias=False)
98
+ self.o_proj = CastedLinear(self.n_head * self.head_dim, config.hidden_size, bias=False)
99
+
100
+ def _xsa_efficient(self, y: Tensor, v_current: Tensor) -> Tensor:
101
+ B, H, T, D = y.shape
102
+ Hkv = v_current.size(1)
103
+ group = H // Hkv
104
+
105
+ y_g = y.reshape(B, Hkv, group, T, D)
106
+ v_n = F.normalize(v_current, dim=-1).unsqueeze(2)
107
+
108
+ proj = (y_g * v_n).sum(dim=-1, keepdim=True) * v_n
109
+ return (y_g - proj).reshape(B, H, T, D)
110
+
111
+ def forward(self, x, freqs_cis, past_key_value=None, use_cache=False, attention_mask=None):
112
+ B, T, _ = x.size()
113
+
114
+ q = self.q_proj(x).view(B, T, self.n_head, self.head_dim).transpose(1, 2)
115
+ k_current = self.k_proj(x).view(B, T, self.n_kv_heads, self.head_dim).transpose(1, 2)
116
+ v_current = self.v_proj(x).view(B, T, self.n_kv_heads, self.head_dim).transpose(1, 2)
117
+
118
+ q, k_current = apply_rotary_emb(q, k_current, freqs_cis)
119
+
120
+ if past_key_value is not None:
121
+ k, v = past_key_value.update(k_current, v_current, self.layer_idx)
122
+ else:
123
+ k, v = k_current, v_current
124
+
125
+ S = k.size(2)
126
+
127
+ is_causal = past_key_value is None or past_key_value.get_seq_length(self.layer_idx) == T
128
+
129
+ attn_mask = None
130
+ if attention_mask is not None:
131
+ key_pad = attention_mask.to(torch.bool)[:, None, None, :]
132
+
133
+ if is_causal and T > 1:
134
+ causal = torch.ones(T, S, dtype=torch.bool, device=x.device).tril(diagonal=S - T)
135
+ attn_mask = key_pad & causal[None, None, :, :]
136
+ else:
137
+ attn_mask = key_pad.expand(B, 1, T, S)
138
+
139
+ is_causal = False
140
+
141
+ y = F.scaled_dot_product_attention(
142
+ q,
143
+ k,
144
+ v,
145
+ attn_mask=attn_mask,
146
+ is_causal=is_causal,
147
+ enable_gqa=(self.n_kv_heads != self.n_head),
148
+ )
149
+
150
+ if self.xsa_projection:
151
+ y = self._xsa_efficient(y, v_current)
152
+
153
+ y = y.transpose(1, 2).contiguous().view(B, T, self.n_head * self.head_dim)
154
+ return self.o_proj(y)
155
+
156
+
157
+ class GPTMLP(nn.Module):
158
+ def __init__(self, config):
159
+ super().__init__()
160
+ self.w_gate = CastedLinear(config.hidden_size, config.intermediate_size, bias=False)
161
+ self.w_up = CastedLinear(config.hidden_size, config.intermediate_size, bias=False)
162
+ self.w_down = CastedLinear(config.intermediate_size, config.hidden_size, bias=False)
163
+
164
+ def forward(self, x):
165
+ return self.w_down(F.silu(self.w_gate(x)) * self.w_up(x))
166
+
167
+
168
+ class GPTBlock(nn.Module):
169
+ def __init__(self, config, layer_idx):
170
+ super().__init__()
171
+ self.ln_1 = RMSNorm(config.hidden_size, eps=config.rms_norm_eps)
172
+ self.attn = GPTAttention(config, layer_idx)
173
+ self.ln_2 = RMSNorm(config.hidden_size, eps=config.rms_norm_eps)
174
+ self.mlp = GPTMLP(config)
175
+
176
+ def forward(self, x, freqs_cis, past_key_value=None, use_cache=False, attention_mask=None):
177
+ x = x + self.attn(self.ln_1(x), freqs_cis, past_key_value, use_cache, attention_mask=attention_mask)
178
+ x = x + self.mlp(self.ln_2(x))
179
+ return x
180
+
181
+
182
+ class GPTPreTrainedModel(PreTrainedModel):
183
+ config_class = GPTConfig
184
+ base_model_prefix = "transformer"
185
+ supports_gradient_checkpointing = False
186
+
187
+ def _init_weights(self, module):
188
+ std = self.config.hidden_size ** -0.5
189
+ if isinstance(module, nn.Linear):
190
+ torch.nn.init.normal_(module.weight, mean=0.0, std=std)
191
+ elif isinstance(module, nn.Embedding):
192
+ torch.nn.init.normal_(module.weight, mean=0.0, std=std)
193
+
194
+
195
+ class GPTForCausalLM(GPTPreTrainedModel, GenerationMixin):
196
+ _tied_weights_keys = {"lm_head.weight": "transformer.wte.weight"}
197
+
198
+ def __init__(self, config):
199
+ super().__init__(config)
200
+ self.config = config
201
+ self.transformer = nn.ModuleDict(dict(
202
+ wte=nn.Embedding(config.vocab_size, config.hidden_size),
203
+ h=nn.ModuleList([GPTBlock(config, i) for i in range(config.num_hidden_layers)]),
204
+ ln_f=RMSNorm(config.hidden_size, eps=config.rms_norm_eps),
205
+ ))
206
+ self.lm_head = CastedLinear(config.hidden_size, config.vocab_size, bias=False)
207
+ if config.tie_word_embeddings:
208
+ self.lm_head.weight = self.transformer["wte"].weight
209
+ self._freqs_cis_cache = None
210
+ self.post_init()
211
+ restore_fp32_params(self)
212
+
213
+ def _apply(self, fn):
214
+ module = super()._apply(fn)
215
+ restore_fp32_params(self)
216
+ return module
217
+
218
+ def get_input_embeddings(self):
219
+ return self.transformer["wte"]
220
+
221
+ def set_input_embeddings(self, value):
222
+ self.transformer["wte"] = value
223
+
224
+ def get_output_embeddings(self):
225
+ return self.lm_head
226
+
227
+ def set_output_embeddings(self, new_embeddings):
228
+ self.lm_head = new_embeddings
229
+
230
+ def prepare_inputs_for_generation(self, input_ids, past_key_values=None, attention_mask=None, **kwargs):
231
+ if past_key_values is not None and past_key_values.get_seq_length() > 0:
232
+ input_ids = input_ids[:, -1:]
233
+ return {
234
+ "input_ids": input_ids,
235
+ "attention_mask": attention_mask,
236
+ "past_key_values": past_key_values,
237
+ "use_cache": True,
238
+ }
239
+
240
+ def _get_freqs_cis(self, seq_len, device):
241
+ cache = self._freqs_cis_cache
242
+ if cache is None or cache[0].device != device or cache[0].size(0) < seq_len:
243
+ cache = tuple(
244
+ tensor.to(device)
245
+ for tensor in precompute_rope_cos_sin(self.config.head_dim, seq_len, self.config.rope_theta)
246
+ )
247
+ if torch.is_inference_mode_enabled():
248
+ return cache[0][:seq_len], cache[1][:seq_len]
249
+ self._freqs_cis_cache = cache
250
+ return cache[0][:seq_len], cache[1][:seq_len]
251
+
252
+ def forward(
253
+ self,
254
+ input_ids,
255
+ attention_mask=None,
256
+ labels=None,
257
+ past_key_values: Optional[DynamicCache] = None,
258
+ use_cache=False,
259
+ **kwargs,
260
+ ):
261
+ B, T = input_ids.size()
262
+ if use_cache and past_key_values is None:
263
+ past_key_values = DynamicCache()
264
+
265
+ past_len = past_key_values.get_seq_length() if past_key_values is not None else 0
266
+ x = self.transformer["wte"](input_ids)
267
+ freqs_cis = self._get_freqs_cis(past_len + T, input_ids.device)[past_len:]
268
+
269
+ for block in self.transformer["h"]:
270
+ x = block(x, freqs_cis, past_key_values if use_cache else None, use_cache, attention_mask=attention_mask)
271
+
272
+ x = self.transformer["ln_f"](x)
273
+ logits = self.lm_head(x)
274
+
275
+ loss = None
276
+ if labels is not None:
277
+ if getattr(self.config, "labels_are_shifted", False):
278
+ loss = F.cross_entropy(logits.float().reshape(-1, logits.size(-1)), labels.reshape(-1))
279
+ else:
280
+ shift_logits = logits[..., :-1, :].contiguous()
281
+ shift_labels = labels[..., 1:].contiguous()
282
+ loss = F.cross_entropy(shift_logits.float().view(-1, shift_logits.size(-1)), shift_labels.reshape(-1))
283
+
284
+ return CausalLMOutputWithPast(
285
+ loss=loss,
286
+ logits=logits,
287
+ past_key_values=past_key_values if use_cache else None,
288
+ )
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d2f5b69edddb13b236e7954fa6252249955a5b06e764b7cc64ba3c1f7b9e5ed9
3
+ size 13657760
special_tokens_map.json ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "additional_special_tokens": [
3
+ "<|endoftext|>"
4
+ ],
5
+ "bos_token": "<|bos|>",
6
+ "eos_token": "<|eos|>",
7
+ "pad_token": "<|pad|>",
8
+ "unk_token": "<|unk|>"
9
+ }
tokenizer_config.json ADDED
@@ -0,0 +1,11 @@
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "additional_special_tokens": [
3
+ "<|endoftext|>"
4
+ ],
5
+ "bos_token": "<|bos|>",
6
+ "eos_token": "<|eos|>",
7
+ "model_max_length": 512,
8
+ "pad_token": "<|pad|>",
9
+ "tokenizer_class": "GPT2TokenizerFast",
10
+ "unk_token": "<|unk|>"
11
+ }
vocab.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"<|pad|>":0,"<|bos|>":1,"<|eos|>":2,"<|unk|>":3,"<|endoftext|>":4,"!":5,"\"":6,"#":7,"$":8,"%":9,"&":10,"'":11,"(":12,")":13,"*":14,"+":15,",":16,"-":17,".":18,"/":19,"0":20,"1":21,"2":22,"3":23,"4":24,"5":25,"6":26,"7":27,"8":28,"9":29,":":30,";":31,"<":32,"=":33,">":34,"?":35,"@":36,"A":37,"B":38,"C":39,"D":40,"E":41,"F":42,"G":43,"H":44,"I":45,"J":46,"K":47,"L":48,"M":49,"N":50,"O":51,"P":52,"Q":53,"R":54,"S":55,"T":56,"U":57,"V":58,"W":59,"X":60,"Y":61,"Z":62,"[":63,"\\":64,"]":65,"^":66,"_":67,"`":68,"a":69,"b":70,"c":71,"d":72,"e":73,"f":74,"g":75,"h":76,"i":77,"j":78,"k":79,"l":80,"m":81,"n":82,"o":83,"p":84,"q":85,"r":86,"s":87,"t":88,"u":89,"v":90,"w":91,"x":92,"y":93,"z":94,"{":95,"|":96,"}":97,"~":98,"¡":99,"¢":100,"£":101,"¤":102,"¥":103,"¦":104,"§":105,"¨":106,"©":107,"ª":108,"«":109,"¬":110,"®":111,"¯":112,"°":113,"±":114,"²":115,"³":116,"´":117,"µ":118,"¶":119,"·":120,"¸":121,"¹":122,"º":123,"»":124,"¼":125,"½":126,"¾":127,"¿":128,"À":129,"Á":130,"Â":131,"Ã":132,"Ä":133,"Å":134,"Æ":135,"Ç":136,"È":137,"É":138,"Ê":139,"Ë":140,"Ì":141,"Í":142,"Î":143,"Ï":144,"Ð":145,"Ñ":146,"Ò":147,"Ó":148,"Ô":149,"Õ":150,"Ö":151,"×":152,"Ø":153,"Ù":154,"Ú":155,"Û":156,"Ü":157,"Ý":158,"Þ":159,"ß":160,"à":161,"á":162,"â":163,"ã":164,"ä":165,"å":166,"æ":167,"ç":168,"è":169,"é":170,"ê":171,"ë":172,"ì":173,"í":174,"î":175,"ï":176,"ð":177,"ñ":178,"ò":179,"ó":180,"ô":181,"õ":182,"ö":183,"÷":184,"ø":185,"ù":186,"ú":187,"û":188,"ü":189,"ý":190,"þ":191,"ÿ":192,"Ā":193,"ā":194,"Ă":195,"ă":196,"Ą":197,"ą":198,"Ć":199,"ć":200,"Ĉ":201,"ĉ":202,"Ċ":203,"ċ":204,"Č":205,"č":206,"Ď":207,"ď":208,"Đ":209,"đ":210,"Ē":211,"ē":212,"Ĕ":213,"ĕ":214,"Ė":215,"ė":216,"Ę":217,"ę":218,"Ě":219,"ě":220,"Ĝ":221,"ĝ":222,"Ğ":223,"ğ":224,"Ġ":225,"ġ":226,"Ģ":227,"ģ":228,"Ĥ":229,"ĥ":230,"Ħ":231,"ħ":232,"Ĩ":233,"ĩ":234,"Ī":235,"ī":236,"Ĭ":237,"ĭ":238,"Į":239,"į":240,"İ":241,"ı":242,"IJ":243,"ij":244,"Ĵ":245,"ĵ":246,"Ķ":247,"ķ":248,"ĸ":249,"Ĺ":250,"ĺ":251,"Ļ":252,"ļ":253,"Ľ":254,"ľ":255,"Ŀ":256,"ŀ":257,"Ł":258,"ł":259,"Ń":260,"Ġt":261,"Ġa":262,"in":263,"he":264,"re":265,"on":266,"Ġthe":267,"at":268,"er":269,"Ġs":270,"Ġo":271,"Ġc":272,"en":273,"es":274,"is":275,"al":276,"it":277,"or":278,"nd":279,"Ġw":280,"Ġp":281,"ing":282,"ĠĠ":283,"Ġf":284,"an":285,"ion":286,"Ġb":287,"Ġof":288,"ed":289,"ou":290,"Ġm":291,"Ġin":292,"ar":293,"ic":294,"Ġd":295,"Ġand":296,"le":297,"Ġto":298,"ro":299,"ct":300,"00":301,"Ġe":302,"ent":303,"Ġth":304,"st":305,"om":306,"Ġre":307,"ve":308,"Ġh":309,"as":310,"Ġn":311,"et":312,"Ġis":313,"Ġl":314,"il":315,"ĠĠĠĠ":316,"ation":317,"im":318,"ly":319,"ra":320,"ĠT":321,"ol":322,"ce":323,"Ġg":324,"ut":325,"ow":326,"ig":327,"âĢ":328,"se":329,"ot":330,"Ġu":331,"id":332,"Ġfor":333,"ul":334,"Ġbe":335,"Ġy":336,"Ġ1":337,"ch":338,"ĠA":339,"Ġ(":340,"ĠI":341,"ur":342,"ĠS":343,"Ġst":344,"ver":345,"Ġon":346,"Ġthat":347,"am":348,"Ġcon":349,"ĠC":350,"if":351,"000":352,"ith":353,"Ġyou":354,"el":355,"um":356,"Ġpro":357,"qu":358,"ir":359,"Ġ2":360,"Ġan":361,"ay":362,"Ġas":363,"Ġwith":364,"od":365,"ate":366,"Ġit":367,"Ġare":368,"ge":369,"Ġex":370,"Ġv":371,"Ġal":372,"ĠP":373,"Ġor":374,"ab":375,"ter":376,"her":377,"ĠM":378,"ect":379,"ad":380,"res":381,"Âł":382,"Ġ=":383,"Ġwh":384,"ĠThe":385,"ers":386,"ist":387,"ity":388,"Ġcom":389,"ment":390,"ess":391,"iv":392,"ive":393,"Ġde":394,"ĠĠĠĠĠĠĠĠ":395,"âĶ":396,"ies":397,"Ġwe":398,"pl":399,"th":400,"te":401,"igh":402,"os":403,"est":404,"Ġcan":405,"ore":406,"ĠB":407,"Ġsu":408,"us":409,"ĠF":410,"Ġr":411,"ill":412,"ial":413,"ke":414,"ĠE":415,"un":416,"op":417,"end":418,"--":419,"Ġby":420,"ac":421,"ain":422,"ĠD":423,"em":424,"ant":425,"Ġhe":426,"nt":427,"ure":428,"and":429,"ĠW":430,"ĠR":431,"âĶĢ":432,"pp":433,"ri":434,"rom":435,"ions":436,"ical":437,"âĶĢâĶĢ":438,"ĠH":439,"ight":440,"Ġat":441,"oc":442,"Ġch":443,"ld":444,"Ġse":445,"Ġthis":446,"Ġne":447,"Ġha":448,"Ġle":449,"ine":450,"âĢĻ":451,"ud":452,"ort":453,"Ġ\\":454,"art":455,"ĠL":456,"Ġfrom":457,"Ġ0":458,"per":459,"pt":460,"Ġsh":461,"Ġus":462,"og":463,"ĠâĢ":464,"pe":465,"ĠN":466,"ple":467,"iz":468,"..":469,"all":470,"Ġ3":471,"act":472,"##":473,"ag":474,"Ġnot":475,"ations":476,"Ġen":477,"rou":478,"ult":479,"Ġhave":480,"du":481,"Ġim":482,"ere":483,"Ġab":484,"ĠG":485,"ction":486,"Ġ-":487,"age":488,"Ġyour":489,"ff":490,"Ġk":491,"Ġ$":492,"are":493,"our":494,"orm":495,"ome":496,"out":497,"ost":498,"Ġwor":499,"Ġwhe":500,"ich":501,"ĠO":502,"Ġres":503,"ust":504,"ould":505,"xt":506,"ard":507,"ated":508,"Ġpl":509,"ance":510,"low":511,"The":512,"ue":513,"able":514,"gh":515,"ans":516,"ide":517,"ther":518,"Ġad":519,"ber":520,"ble":521,"ĠTh":522,"Ġme":523,"ĠĠĠ":524,"ast":525,"ind":526,"ous":527,"Ġint":528,"ach":529,"ĠIn":530,"ak":531,"int":532,"Ġ+":533,"ign":534,"Ġwill":535,"Ġinc":536,"ell":537,"ap":538,"Ġcont":539,"Ġ4":540,"Ġtheir":541,"Ġcomp":542,"'s":543,"ks":544,"cc":545,"Ġdo":546,"Ġwhich":547,"Ġtr":548,"vel":549,"ents":550,"ence":551,"ual":552,"ip":553,"ie":554,"ime":555,"Ġun":556,"ep":557,"ress":558,"ĠU":559,"Ġwas":560,"ary":561,"Ġdis":562,"of":563,"Ġper":564,"ong":565,"ition":566,"ire":567,"ass":568,"Ġnum":569,"ase":570,"ĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠ":571,"Ġcl":572,"Ġqu":573,"ru":574,"ath":575,"----":576,"Ġj":577,"iff":578,"³³":579,"Ġthey":580,"Ġ5":581,"01":582,"ang":583,"Ġmore":584,"ens":585,"Ġone":586,"ors":587,"ces":588,"ear":589,"form":590,"Ġall":591,"Ġhas":592,"Ġx":593,"Ġsp":594,").":595,"ace":596,"Ġar":597,"âĶĢâĶĢâĶĢâĶĢ":598,"Ġli":599,"oo":600,"ph":601,"ĠJ":602,"ric":603,"so":604,"Ġout":605,"text":606,"Ġpre":607,"Ġte":608,"ater":609,"ari":610,"Ġimp":611,"Ġsy":612,"Ġother":613,"Ġbut":614,"ating":615,"Ġ\"":616,"ite":617,"__":618,"Ġman":619,"ake":620,"Ġif":621,"ame":622,"Ġdiff":623,"nder":624,"Ġequ":625,"ood":626,"Ġval":627,"one":628,"Ġpo":629,"Ġabout":630,"ile":631,"Ġev":632,"av":633,"Ġsc":634,"ms":635,"Ġapp":636,"Ġpart":637,"Ġbet":638,"),":639,"now":640,"Ġhow":641,"Ġro":642,"very":643,"ond":644,"ound":645,"ice":646,"Ġso":647,"ack":648,"ĠThis":649,"ry":650,"ree":651,"``":652,"Ġalso":653,"ub":654,"ics":655,"ĠV":656,"Ġinto":657,"ose":658,"Ġthese":659,"Ġtw":660,"les":661,"Ġtime":662,"au":663,"we":664,"ative":665,"ys":666,"rac":667,"ific":668,"Ġlike":669,"ory":670,"Ġspe":671,"ord":672,"lect":673,"Ġ6":674,"ates":675,"Ġuse":676,"Ġthere":677,"ject":678,"ount":679,"Ġup":680,"Ġwhen":681,"Ġâ":682,"Ġfun":683,"eth":684,"Ġmod":685,"ution":686,"ia":687,"ata":688,"stem":689,"{\\":690,"Ġsome":691,"Ġdiffere":692,"Ġinter":693,"Ġits":694,"âĢĿ":695,"ĠK":696,"Ġ.":697,"Ġcomm":698,"Ġthem":699,"ility":700,"Ġstud":701,"Ġsol":702,"Ġunder":703,"ll":704,"ities":705,"Ġ[":706,"ĠY":707,"ments":708,"ĠSt":709,"Ġthan":710,"ail":711,"king":712,"rough":713,"Ġtwo":714,"Ġcons":715,"ĠIt":716,"ays":717,"rib":718,"cul":719,"ild":720,"ne":721,"Ġem":722,"ally":723,"cess":724,"Ġbec":725,"Ġexp":726,"ft":727,"Ġfe":728,"Ġknow":729,"vers":730,"olog":731,"ract":732,"ove":733,"|>":734,"âĢ¢":735,"ons":736,"Ġind":737,"<|":738,"endof":739,"endoftext":740,"ings":741,"Ġrel":742,"Ġcol":743,"Ġob":744,"Ġour":745,"rad":746,"Ġform":747,"ample":748,"Ġneed":749,"Ġnumber":750,"Ġany":751,"Ġover":752,"Ġsuch":753,"Ġdes":754,"Ġvari":755,"irst":756,"Ġpos":757,"ib":758,"Ġhel":759,"Ġmay":760,"Ġacc":761,"ning":762,"Ġeff":763,"ient":764,"Ġco":765,"Ġwhat":766,"ween":767,"In":768,"Ġam":769,"10":770,"Ġhelp":771,"Ġsim":772,"ĠâĢľ":773,"Ġrec":774,"Ġass":775,"Ġcre":776,"Ġact":777,"ange":778,"ĠâĢĵ":779,"Ġbetween":780,"its":781,"Ġgen":782,"Ġsystem":783,"Ġ10":784,"lud":785,"erm":786,"row":787,"rit":788,"Ġgo":789,"ns":790,"erv":791,"Ġ7":792,"Ġthen":793,"ular":794,"_{":795,"Ġeach":796,"ures":797,"Ġpe":798,"Ġwould":799,"ough":800,"Ġadd":801,"Ġused":802,"ov":803,"ef":804,"ues":805,"ise":806,"oth":807,"ram":808,"**":809,"hat":810,"ob":811,"ause":812,"ower":813,"$$":814,"Ġag":815,"Ġdata":816,"Ġthrough":817,"Ġwhere":818,"Ġusing":819,"tain":820,"Ġprov":821,"Ġtrans":822,"Ġpoint":823,"Ġ8":824,"Ġsub":825,"Ġwere":826,"als":827,"Ġrep":828,"ced":829,"ollow":830,"ĠCh":831,"ful":832,"Ġ201":833,"Ġset":834,"Ġreg":835,"Ġdec":836,"Ġdifferent":837,"Ġwho":838,"Ġdist":839,"Ġinv":840,"uring":841,"Ġmat":842,"ec":843,"red":844,"ible":845,"ish":846,"Ġpr":847,"Ġget":848,"ax":849,"Ġwork":850,"Ġprodu":851,"Ġspec":852,"Ġonly":853,"Ġph":854,"Ġno":855,"Ġinte":856,"Ġac":857,"ased":858,"ize":859,"alcul":860,"Ġnew":861,"round":862,"Ġfirst":863,"Ġ9":864,"ook":865,"erg":866,"Ġfunction":867,"Ġsign":868,"Ġdi":869,"Ġbl":870,"ential":871,"stand":872,"reat":873,"ting":874,"}}":875,"Ġfollow":876,"ss":877,"Ġinclud":878,"alth":879,"ian":880,"Ġresult":881,"12":882,"Ġ19":883,"Ġshow":884,"chn":885,"plic":886,"Ġproble":887,"ople":888,"velop":889,"the":890,"Ġ|":891,"ational":892,"ict":893,"put":894,"Ġdet":895,"eng":896,"Ġrem":897,"enc":898,"Ġdisc":899,"hes":900,"ng":901,"ark":902,"Ġfind":903,"resent":904,"Ġyear":905,"--------":906,"iven":907,"Ġinst":908,"Ġ{":909,"Ġdef":910,"ĠPro":911,"ten":912,"frac":913,"Ġsm":914,"ick":915,"Ġcur":916,"old":917,"Ġfl":918,"ethod":919,"cept":920,"nce":921,"Ġsur":922,"Ġoff":923,"pect":924,"...":925,"rain":926,"ruct":927,"Ġlear":928,"ĠIf":929,"ied":930,"Ġexper":931,"Ġinf":932,"Ġbeen":933,"ps":934,"Ġty":935,"Ġmany":936,"Ġfact":937,"ĠFor":938,"Ġcor":939,"Ġgener":940,"uc":941,"11":942,"Ġjust":943,"iew":944,"ious":945,"###":946,"Ġpeople":947,"Ġvalue":948,"}{":949,"20":950,"fore":951,"imes":952,"hem":953,"^{":954,"Ġ&":955,"Ġexpl":956,"ink":957,"ĠWe":958,"ives":959,"fter":960,"Ġmost":961,"Ġcomple":962,"Ġsa":963,"Ġshould":964,"Ġi":965,"Th":966,"get":967,"ĠHow":968,"'t":969,"hed":970,"ont":971,"Ġsame":972,"ature":973,"Ġsec":974,"raph":975,"aking":976,"hen":977,"ines":978,"ically":979,"Ġdevelop":980,"Ġappro":981,"ever":982,"Ġstr":983,"right":984,"Ġevery":985,"Ġmy":986,"Ġra":987,"ability":988,"Ġprocess":989,"âĶĢâĶĢâĶĢâĶĢâĶĢâĶĢâĶĢ��ĶĢ":990,"Ġmodel":991,"Ġsee":992,"Ġref":993,"ĠâĪ":994,"ĠRe":995,"bers":996,"ience":997,"sel":998,"Ġ20":999,"Ġhis":1000,"____":1001,"ural":1002,"Ġeffect":1003,"ĠEx":1004,"Ġcould":1005,"Ġmake":1006,"com":1007,"Ġexample":1008,"Ġsupp":1009,"}\\":1010,"ness":1011,"Ġmin":1012,"Ġconst":1013,"ivid":1014,"Ġimport":1015,"Ġtechn":1016,"ices":1017,"))":1018,"eld":1019,"Ġdoes":1020,"Ġke":1021,"iss":1022,"Ġmethod":1023,"Ġhigh":1024,"Ġway":1025,"Ġcalcul":1026,"ĠQ":1027,"Ġincre":1028,"math":1029,"Ġrequ":1030,"formation":1031,"³³³³":1032,"ection":1033,"urn":1034,"ĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠ":1035,"Ġhealth":1036,"Ġline":1037,"ĠCom":1038,"Ġunderstand":1039,"Ġwell":1040,"Ġ200":1041,"iqu":1042,"ator":1043,"ident":1044,"Ġboth":1045,"Ġeven":1046,"ex":1047,"Ġ:":1048,"ized":1049,"Ġpers":1050,"uch":1051,"ĠÂł":1052,"cl":1053,"Ġbu":1054,"Ġcall":1055,"Ġins":1056,"ĠUn":1057,"Ġright":1058,"Ġquest":1059,"ving":1060,"wor":1061,"tern":1062,"ology":1063,"ix":1064,"ward":1065,"arch":1066,"Ġbecause":1067,"Ġap":1068,"ts":1069,"Ġpartic":1070,"ined":1071,"19":1072,"cial":1073,"Ġpar":1074,"ield":1075,"Ġmult":1076,"aw":1077,"inal":1078,"ases":1079,"Ġed":1080,"own":1081,"der":1082,"oci":1083,"ily":1084,"other":1085,"Ġwhile":1086,"Ġz":1087,"ages":1088,"Ġ12":1089,"Ġlong":1090,"ife":1091,"Ġ)":1092,"ode":1093,"ider":1094,"Ġ,":1095,"ute":1096,"Ġtest":1097,"Ġent":1098,"oy":1099,"Ġpat":1100,"Ġext":1101,"Ġanal":1102,"ually":1103,"ality":1104,"itive":1105,"ergy":1106,"Ġchar":1107,"Ġmeas":1108,"Ġdep":1109,"Ġ/":1110,"....":1111,"rent":1112,"Ġwater":1113,"ool":1114,"line":1115,"Ġ*":1116,"ism":1117,"ists":1118,"vent":1119,"ty":1120,"Ġend":1121,"hip":1122,"ency":1123,"ĠAl":1124,"15":1125,"ional":1126,"Ġpower":1127,"Ġ<":1128,"Ġgiven":1129,"ĠAn":1130,"Ġmed":1131,"Ġhad":1132,"Ġart":1133,"irc":1134,"Ġatt":1135,".,":1136,"ren":1137,"omet":1138,"ave":1139,"ants":1140,"Ġprog":1141,"ered":1142,"Ġlar":1143,"con":1144,"Ġcommun":1145,"13":1146,"Ġve":1147,"ock":1148,"ify":1149,"ade":1150,"wn":1151,"Ġ'":1152,"gan":1153,"Ġcent":1154,"ince":1155,"ets":1156,"Ġ`":1157,"Ġcar":1158,"ĠAs":1159,"ization":1160,"Ġsk":1161,"Ġworld":1162,"Ġchild":1163,"ubl":1164,"ples":1165,"rest":1166,"Ġthose":1167,"Ġstart":1168,"Ġele":1169,"itions":1170,"25":1171,"eg":1172,"Ġlevel":1173,"pr":1174,"ĠYou":1175,"Ġclass":1176,"wer":1177,"left":1178,"mer":1179,"io":1180,"Ġposs":1181,"Ġread":1182,"16":1183,"}$":1184,"Ġafter":1185,"Ġopt":1186,"Ġlead":1187,"Ġher":1188,"Ġproblem":1189,"Ġ$$":1190,"Ġpol":1191,"led":1192,"Ġsmall":1193,"Ġgrou":1194,"14":1195,"Ġmain":1196,"ger":1197,"Ġfollowing":1198,"Ġpract":1199,"ci":1200,"imate":1201,"Ġloc":1202,"cer":1203,"Ġdesign":1204,"ides":1205,"uss":1206,"Ġdire":1207,"Ġduring":1208,"ved":1209,"cent":1210,"Ġaut":1211,"Ġcond":1212,"Ġmean":1213,"ety":1214,"ves":1215,"Ġest":1216,"Ġrese":1217,"This":1218,"Ġback":1219,"ross":1220,"Ġmuch":1221,"ĠÎ":1222,"iron":1223,"ody":1224,"Ġinformation":1225,"Ġreal":1226,"Ġear":1227,"ĠX":1228,"Ġimportant":1229,"Ġvery":1230,"Ġredu":1231,"Ġfound":1232,"gr":1233,"Ġallow":1234,"arm":1235,"akes":1236,"ited":1237,"Ġwithin":1238,"Ġhum":1239,"Ġstudents":1240,"Ġmon":1241,"Ġbeing":1242,"Ġelect":1243,"Ġless":1244,"read":1245,"Ġenergy":1246,"to":1247,"ted":1248,"ier":1249,"Ġlet":1250,"Ġmust":1251,"ck":1252,"Ġyears":1253,"ĠCon":1254,"val":1255,"Ġoper":1256,"gg":1257,"air":1258,"Ġ$\\":1259,"Ġresp":1260,"here":1261,"ision":1262,"50":1263,"ateg":1264,"Ġret":1265,"Ġtake":1266,"Ġplay":1267,"ital":1268,"ins":1269,"Ġconf":1270,"up":1271,"Ġvalues":1272,"ray":1273,"Ġcount":1274,"ividual":1275,"ĠWhat":1276,"Ġstate":1277,"Ġmight":1278,"Ġgu":1279,"Ġnumbers":1280,"ering":1281,"ew":1282,"rodu":1283,"ivity":1284,"rol":1285,"ands":1286,"ĠâĢ¢":1287,"18":1288,"Ġtra":1289,"Ġca":1290,"Ġgrow":1291,"Ġshe":1292,"Ġpot":1293,"Ġans":1294,"Ġav":1295,"Ġ#":1296,"Ġvol":1297,"ression":1298,"Ġident":1299,"Ġwant":1300,"Ġmet":1301,"ĠHe":1302,"ox":1303,"ĠThese":1304,"over":1305,"Ġsecond":1306,"Ġcontin":1307,");":1308,"Ġthree":1309,"Ġoften":1310,"ull":1311,"],":1312,"Ġperson":1313,"Ġcase":1314,"viron":1315,"Ġdown":1316,"Ġsignific":1317,"atic":1318,"und":1319,"ale":1320,"dd":1321,"Ġplan":1322,"ma":1323,"ulation":1324,"ðĿ":1325,"Ġproduct":1326,"Ġser":1327,"ĠThey":1328,"//":1329,"Ġperform":1330,"==":1331,"Ġindividual":1332,"Ġbefore":1333,"ength":1334,"Ġaround":1335,"17":1336,"âĪ":1337,"22":1338,"ared":1339,"ctions":1340,"Ġrequire":1341,"Ġgl":1342,"agn":1343,"Ġnon":1344,"pos":1345,"Ġsupport":1346,"ote":1347,"ron":1348,"ected":1349,"Ġproper":1350,"chool":1351,"aterial":1352,"Ġadv":1353,"Ġstudy":1354,"ctor":1355,"ots":1356,"Ġequation":1357,"Ġ18":1358,"Ġeng":1359,"par":1360,"Ġchange":1361,"Ġhist":1362,"utions":1363,"Ġlife":1364,"Ġobject":1365,"Ġgood":1366,"Ġcalled":1367,"Ġsum":1368,"âĢĵ":1369,"self":1370,"Ġnow":1371,"ables":1372,"Ġtyp":1373,"Ġown":1374,"Ġpop":1375,"ather":1376,"rix":1377,"Ġconn":1378,"ences":1379,"Ġorder":1380,"30":1381,"Ġstand":1382,"ven":1383,"ysis":1384,"amet":1385,"for":1386,"Ġsl":1387,"Ġfam":1388,"any":1389,"Ġlit":1390,"Ġmulti":1391,"Ġimpro":1392,"Ġtem":1393,"Ġinterest":1394,"work":1395,"acter":1396,"olution":1397,"Ġmeasure":1398,"Ġsym":1399,"ilar":1400,"Ġ15":1401,"ivers":1402,"Ġfin":1403,"ĠSo":1404,"port":1405,"Ġï":1406,"Ġprof":1407,"ta":1408,"Ġlearn":1409,"Ġcommon":1410,"Ġcurrent":1411,"Ġcle":1412,"Ġide":1413,"ĠWh":1414,"Ġeas":1415,"Ġstep":1416,"ĠBy":1417,"24":1418,"Ġhere":1419,"Ġdon":1420,"Ġtop":1421,"Ġcell":1422,"Ġris":1423,"Ġbased":1424,"Ġhy":1425,"Ġprob":1426,"Ġmem":1427,"ination":1428,"Ġagain":1429,"ĠĠĠĠĠĠĠ":1430,"ĠThere":1431,"Ġcirc":1432,"Ġcare":1433,"Ġdeterm":1434,"(\\":1435,"Ġmeans":1436,"err":1437,"ĠTo":1438,"Ġfield":1439,"oss":1440,"br":1441,"ains":1442,"Ġbeh":1443,"Ġtoo":1444,"Ġexam":1445,"oint":1446,"verse":1447,"Ġcap":1448,"ume":1449,"itional":1450,"Ġinvol":1451,"ĠÂłĠÂł":1452,"ental":1453,"Ġenviron":1454,"tle":1455,"imal":1456,"Ġvis":1457,"AT":1458,"ffic":1459,"23":1460,"Ġop":1461,"Ġprot":1462,"Ġmade":1463,"Ġcorre":1464,"day":1465,"ead":1466,"ique":1467,"ert":1468,"rt":1469,"Ġfre":1470,"Ġchang":1471,"less":1472,"igure":1473,"Ġword":1474,"ĠÂ":1475,"iving":1476,"tt":1477,"Ġcult":1478,"Ġcomput":1479,"Ġ>":1480,"ĠBut":1481,"Ġbas":1482,"str":1483,"Ġcomplex":1484,"99":1485,"Ġsqu":1486,"Ġmaterial":1487,"oid":1488,"Ġens":1489,"Ġconsider":1490,"ense":1491,"Ġdel":1492,"Ġcost":1493,"Ġdem":1494,"ĠAnd":1495,"Ġvarious":1496,"Ġ16":1497,"Ġpotential":1498,"Ġche":1499,"Ġwithout":1500,"ank":1501,"Ġarea":1502,"sc":1503,"Ġlearning":1504,"ars":1505,"iod":1506,"Ġlim":1507,"Ġtrad":1508,"Ġhand":1509,"Ġthough":1510,"ption":1511,"Ġsignificant":1512,"Ġbre":1513,"rm":1514,"Ġserv":1515,"vert":1516,"ways":1517,"play":1518,"ner":1519,"ĠSh":1520,"ula":1521,"âĢĶ":1522,"Ġdistrib":1523,"ret":1524,"Ġpresent":1525,"Ġrepresent":1526,"Ġsolution":1527,"Ġabove":1528,"Ġpost":1529,"Ġstruct":1530,"Ġresults":1531,"ocial":1532,"Ġdev":1533,"ĠHowever":1534,"Ġocc":1535,"Ġbetter":1536,"Ġanother":1537,"Ġday":1538,"Ġang":1539,"Ġel":1540,"ern":1541,"Ġbel":1542,"Ġphys":1543,"ior":1544,"Ġaff":1545,"ances":1546,"ients":1547,"ources":1548,"33":1549,"Ġcour":1550,"Ġpossible":1551,"Ġdid":1552,"Ġpoints":1553,"ym":1554,"etic":1555,"oring":1556,"Ġgre":1557,"ified":1558,"Ġess":1559,"Ġbr":1560,"Ġter":1561,"Ġwrit":1562,"Ġdesc":1563,"Ġpubl":1564,"Ġorgan":1565,"view":1566,"Ġspace":1567,"âĶĤ":1568,"ends":1569,"Ġ14":1570,"Ġbuild":1571,"Ġgra":1572,"Ġincluding":1573,"Ġquestion":1574,"Ġequal":1575,"Ġlight":1576,"ĠCl":1577,"ĠSc":1578,"Ġ}":1579,"por":1580,"ash":1581,"iness":1582,"ters":1583,"Ġchall":1584,"If":1585,"Ġlook":1586,"face":1587,"Ġthink":1588,"ĠZ":1589,"cing":1590,"Ġet":1591,"Ġcreate":1592,"ource":1593,"yle":1594,"ĠInd":1595,"bs":1596,"Ġbody":1597,"Ġknown":1598,"Ġresearch":1599,"ories":1600,"oad":1601,"Ġsom":1602,"ason":1603,"Ġtype":1604,"Ġtri":1605,"Ġtreat":1606,"Ġopp":1607,"Ġfood":1608,"Ġiss":1609,"Ġrate":1610,"ething":1611,"urther":1612,"hemat":1613,"ively":1614,"Ġtimes":1615,"Ġ11":1616,"Ġproject":1617,"Ġdig":1618,"Ġrad":1619,"ĠQu":1620,"Ġlist":1621,"Ġdue":1622,"Ġmark":1623,"istic":1624,"Ġlarge":1625,"Ġprom":1626,"Ġaw":1627,"lu":1628,"Ġprovide":1629,"We":1630,"gor":1631,"Ġanswer":1632,"Ġcomb":1633,"AA":1634,"Ġgraph":1635,"Ġgroup":1636,"ccess":1637,"Ġpass":1638,"rop":1639,"angu":1640,"Ġhuman":1641,"Ġapplic":1642,"tem":1643,"Ġcontrol":1644,"ĠÃ":1645,"```":1646,"Ġenvironment":1647,"els":1648,"Ġproblems":1649,"):":1650,"ral":1651,"Ġpur":1652,"Ġben":1653,"0000":1654,"ithm":1655,"Ġsystems":1656,"ĠWhen":1657,"ape":1658,"Ġintegr":1659,"ocus":1660,"ug":1661,"Ġsomething":1662,"40":1663,"Ġstill":1664,"be":1665,"60":1666,"Ġdra":1667,"Ġparticular":1668,"Ġspecific":1669,"Ġpress":1670,"Ġmove":1671,"Ġ13":1672,"Ġflow":1673,"meric":1674,"imum":1675,"tal":1676,"ention":1677,"ĠRes":1678,"ertain":1679,"ero":1680,"ike":1681,"Ġbest":1682,"aces":1683,"ling":1684,"app":1685,"ills":1686,"ER":1687,"Ġcrit":1688,"Ġlog":1689,"Ġstandard":1690,"ently":1691,"28":1692,"----------------":1693,"Ġinvest":1694,"bra":1695,"Ġobs":1696,"ĠâĪĴ":1697,"Ġtool":1698,"Ġorig":1699,"Ġindu":1700,"Ex":1701,"What":1702,"Ġworks":1703,"Ġwhy":1704,"Ġsaf":1705,"Ġlength":1706,"oun":1707,"Ġschool":1708,"verage":1709,"ole":1710,"Ġdr":1711,"Ġunderstanding":1712,"oms":1713,"Ġhapp":1714,"Ġsit":1715,"Ġpres":1716,"Ġwr":1717,"Ġsince":1718,"Ġsize":1719,"27":1720,"As":1721,"Ġsay":1722,"\",":1723,"Ġchildren":1724,"Ġinclude":1725,"Ġrelations":1726,"Ġkeep":1727,"Ġmass":1728,"Ġnorm":1729,"elf":1730,"ium":1731,"nam":1732,"Ġhig":1733,"pro":1734,"201":1735,"Ġmaking":1736,"usion":1737,"Ġeduc":1738,"not":1739,"icle":1740,"ished":1741,"Ġplace":1742,"Ġnet":1743,"Ġtre":1744,"Ġperiod":1745,"Ġprovid":1746,"izing":1747,"St":1748,"Ġprogram":1749,"Ġ100":1750,"Ġmot":1751,"Ġtry":1752,"Ġsing":1753,"21":1754,"ording":1755,"Ġtoget":1756,"Ġtogether":1757,"ration":1758,"ope":1759,"Ġrun":1760,"Ġdiscuss":1761,"Ġkey":1762,"Ġpred":1763,"Ġinit":1764,"ĠPl":1765,"ĠDe":1766,"Ġfeel":1767,"Ġfrequ":1768,"ological":1769,"Ġrest":1770,"Ġterm":1771,"Ġpositive":1772,"Ġimpact":1773,"Ġsocial":1774,"Ġanalysis":1775,"ĠAmeric":1776,"Ġnat":1777,"Ġcy":1778,"ĠIs":1779,"angle":1780,"How":1781,"Ġpa":1782,"apter":1783,"vious":1784,"ah":1785,"Ġ30":1786,"Ġview":1787,"ogn":1788,"Ġamount":1789,"ĠIm":1790,"ument":1791,"Ġneg":1792,"ators":1793,"Ġsaid":1794,"Ġsimple":1795,"ee":1796,"________":1797,"ĠĠĠĠĠ":1798,"Ġmax":1799,"ane":1800,"Ġenc":1801,"26":1802,"me":1803,"Ġsever":1804,"hers":1805,"Ġalways":1806,"Ġlow":1807,"ilities":1808,"Ġaccess":1809,"ining":1810,"Ġtotal":1811,"Ġconcept":1812,"Ġfocus":1813,"For":1814,"co":1815,"omen":1816,"Ġtemper":1817,"Ġbus":1818,"Ġessential":1819,"Ġdevelopment":1820,"Ġlaw":1821,"It":1822,"ird":1823,"agement":1824,"Ġ17":1825,"ived":1826,"imens":1827,"Ġrange":1828,"ending":1829,"ĠPh":1830,"Ġstre":1831,"erence":1832,"uture":1833,"ember":1834,"asing":1835,"cel":1836,"Ġopen":1837,"Ġweight":1838,"29":1839,"Ġsimilar":1840,"â̦":1841,"Ġbelow":1842,"45":1843,"ication":1844,"Ġgreat":1845,"Ġquestions":1846,"Ġthings":1847,"Ġside":1848,"equ":1849,"ĠTe":1850,"Ġfil":1851,"Ġdirect":1852,"Ġimm":1853,"ule":1854,"erc":1855,"Ġcharacter":1856,"Ġrespect":1857,"ðĿij":1858,"Ġcertain":1859,"Ġlangu":1860,"Ġdeg":1861,"ids":1862,"Ġformula":1863,"Ġlast":1864,"To":1865,"conom":1866,"ann":1867,"Ġmatrix":1868,"Ġgr":1869,"Ġterms":1870,"Ġrisk":1871,"Ġstrateg":1872,"Ġcaus":1873,"ats":1874,"Ġalong":1875,"Ġbenef":1876,"Ġfree":1877,"Ġcontrib":1878,"Ġ25":1879,"âĶģ":1880,"Ġconditions":1881,"Ġmus":1882,"py":1883,"gin":1884,"ĠTr":1885,"idence":1886,"Ġbecome":1887,"Ġair":1888,"Ġleft":1889,"inary":1890,"dis":1891,"ĠâĢĺ":1892,"ik":1893,"iversity":1894,".âĢĿ":1895,"Ġseveral":1896,"Ġunit":1897,"ĠWor":1898,"ĠEng":1899,"aj":1900,"Ġacross":1901,"Ġmar":1902,"itud":1903,"Ġ...":1904,"arent":1905,"ither":1906,"Ġalgor":1907,"Ġerr":1908,"wards":1909,"Ġothers":1910,"ploy":1911,"Ġfunctions":1912,"Ch":1913,"ton":1914,"ival":1915,"ĠThat":1916,"by":1917,"Ġassoci":1918,"Ġhome":1919,"âĶģâĶģ":1920,"Ġparamet":1921,"ĠNew":1922,"osed":1923,"Ġmov":1924,"Ġstat":1925,"Ġrelationship":1926,"Ġtext":1927,"80":1928,"Ġnext":1929,"Ġapproach":1930,"Ġchalleng":1931,"Ġspeed":1932,"Ġoccur":1933,"IN":1934,"Ġamong":1935,"nal":1936,"ortun":1937,"Ġavail":1938,"bol":1939,"ĠLet":1940,"ĠEn":1941,"Ġcorrect":1942,"Ġ\\$":1943,"ledge":1944,"35":1945,"Ġfac":1946,"36":1947,"Ġwee":1948,"abor":1949,"atures":1950,"Ġbo":1951,"Ġfour":1952,"||":1953,"ges":1954,"Ġcompon":1955,"Ġdise":1956,"Ġbi":1957,"aging":1958,"Ġsuccess":1959,"Ġdescrib":1960,"Ġgeneral":1961,"Ġeffic":1962,"Ġcourse":1963,"Ġdiv":1964,"75":1965,"Ġways":1966,"Ġinput":1967,"Ġbelie":1968,"lying":1969,"âĶĢâĶĢâĶĢâĶĢâĶĢâĶĢâĶĢâĶĢâĶĢâĶĢâĶĢâĶĢâĶĢâĶĢâĶĢâĶĢ":1970,"sp":1971,"Ġforce":1972,"Ġes":1973,"ON":1974,"Ġleg":1975,"://":1976,"Ġfactors":1977,"hy":1978,"Ġbehav":1979,"Ġrole":1980,"orts":1981,"oft":1982,"Ġgive":1983,"ystem":1984,"Ġseem":1985,"Ġsurface":1986,"mathb":1987,"Ġmethods":1988,"plement":1989,"Ġnecess":1990,"min":1991,"Ġcontain":1992,"ries":1993,"Ġcode":1994,"ener":1995,"Ġant":1996,"Ġtrain":1997,"ww":1998,"ĠWith":1999,"raction":2000,"Ġconstant":2001,")$":2002,"Ġspecial":2003,"ours":2004,"ouse":2005,"Ġpric":2006,"Ġfuture":2007,"ĠÏ":2008,"ĠâĶĤ":2009,"ograph":2010,"Ġactiv":2011,"200":2012,"gebra":2013,"Ġquant":2014,"ĠOr":2015,"Ġsingle":2016,"Ġdistribution":2017,"aps":2018,"Ġder":2019,"ooks":2020,"ĠOn":2021,"Ġimprove":2022,")=":2023,"qrt":2024,"iation":2025,"hor":2026,"####":2027,"Ġnatural":2028,"aring":2029,"Ġhigher":2030,"istics":2031,"lish":2032,"Ġsquare":2033,"Ġunique":2034,"Ġexist":2035,"Ġgover":2036,"Ġable":2037,"ames":2038,"epend":2039,"Ġcontinu":2040,"Ġobserv":2041,"ately":2042,"Ġsw":2043,"}_{":2044,"Ġlocal":2045,"ored":2046,"Ġelements":2047,"Ġtrue":2048,"Ġlinear":2049,"ification":2050,"Ġhard":2051,"utes":2052,"ury":2053,"lection":2054,"plied":2055,"Ġchanges":2056,"Ġ\\(":2057,"az":2058,"ndom":2059,"Ġreturn":2060,"ĠAr":2061,"Ġexperience":2062,"44":2063,"Ġagainst":2064,"omm":2065,"Ġself":2066,"Ġpressure":2067,"Ġequations":2068,"ĠMat":2069,"chan":2070,"Ġfew":2071,"Ġtypes":2072,"ires":2073,"ĠLe":2074,"Ġdistance":2075,"Ġpoly":2076,"ibility":2077,"Ġhistory":2078,"Ġpath":2079,"cy":2080,"90":2081,"Ġmill":2082,"Ġsens":2083,"Ġexperi":2084,"Ġmakes":2085,"Ġmonth":2086,"Ġshort":2087,"Ġfri":2088,"Ġcomplete":2089,"Ġge":2090,"Ġavailable":2091,"Ġgoing":2092,"anced":2093,"Ġunt":2094,">>":2095,"uro":2096,"Ġshown":2097,"ĠOne":2098,"Ġbusiness":2099,"Ġdifference":2100,"Ġrele":2101,"ired":2102,"ights":2103,"Ġq":2104,"Ġleast":2105,"Ġcome":2106,"ĠAd":2107,"inc":2108,"ended":2109,"ards":2110,"let":2111,"ggest":2112,"lam":2113,"Ġclear":2114,"Ġincrease":2115,"Ġindic":2116,"Ġobtain":2117,"Ġneeds":2118,"........":2119,"Ġfactor":2120,"Ġput":2121,"66":2122,"Ġcho":2123,"version":2124,"amp":2125,"fer":2126,"idd":2127,"istance":2128,"Ġeconom":2129,"Ġpain":2130,"Ġwhether":2131,"cos":2132,"thing":2133,"land":2134,"70":2135,"There":2136,"bo":2137,"An":2138,"ably":2139,"Ġbound":2140,"Ġarg":2141,"ES":2142,"iting":2143,"set":2144,"ooking":2145,"cle":2146,"icult":2147,"Ġindividuals":2148,"Ġfore":2149,"Ġoutput":2150,"Ġsure":2151,".\"":2152,"Ġstrong":2153,"Ġexpress":2154,"Ġsoci":2155,"ĠSp":2156,"chie":2157,"Ġlevels":2158,"Ġrece":2159,"Ġpaper":2160,"mit":2161,"mat":2162,"Ġsequ":2163,"Ġvector":2164,"man":2165,"Ġconnect":2166,"Ġtechnology":2167,"nces":2168,"ware":2169,"Ġfurther":2170,"Ġaccount":2171,"48":2172,"Ġpercent":2173,"ission":2174,"where":2175,"style":2176,"].":2177,"95":2178,"Ġmaintain":2179,"Ġwords":2180,"pecial":2181,"omes":2182,"Ġcr":2183,"pi":2184,"ties":2185,"Ġtemperature":2186,"Ġgrowth":2187,"Ġhaving":2188,"Ġgovern":2189,"Ġ50":2190,"aster":2191,"Ġrespons":2192,"38":2193,"Ġmath":2194,"Ġflu":2195,"oot":2196,"Ġlower":2197,"ĠCan":2198,"Ġname":2199,")(":2200,"sing":2201,"apt":2202,"iques":2203,"Ġprevent":2204,"Ġaverage":2205,"},":2206,"icro":2207,"Ġworking":2208,"Ġsuggest":2209,"ĠMe":2210,"tep":2211,"Ġinflu":2212,"action":2213,"Ġexact":2214,"Ġnumer":2215,"Ġprobability":2216,"100":2217,"ised":2218,"Ġhim":2219,"Ġskills":2220,"Ġzero":2221,"Ġpublic":2222,"Ġmagn":2223,"estion":2224,"alu":2225,"Ġlanguage":2226,"Ġill":2227,")\\":2228,"Ġinitial":2229,"Ġanaly":2230,"Ġpractice":2231,"Ġtal":2232,"Ġdom":2233,"Ġsat":2234,"Ġvariable":2235,"()":2236,"arc":2237,"Ġknowledge":2238,"atch":2239,"Ġareas":2240,"Ġrat":2241,"Ġstructure":2242,"Ġfamily":2243,"Ġdetail":2244,"Ġseries":2245,"stit":2246,"Now":2247,")/":2248,"Ġdy":2249,"Pro":2250,"37":2251,"ĠAt":2252,"Ġrandom":2253,"Ġnegative":2254,"Ġtreatment":2255,"place":2256,",âĢĿ":2257,"ĠCol":2258,"oose":2259,"Ġabs":2260,"duct":2261,"Ġaddress":2262,"Ġmil":2263,"Ġbook":2264,"fficient":2265,"Al":2266,"Ġtable":2267,"Ġperformance":2268,"Ġ24":2269,"Ġensure":2270,"Ġachie":2271,"Ġold":2272,"Ġfar":2273,"}^{":2274,"Ġappear":2275,"34":2276,"resp":2277,"orem":2278,"Ġremain":2279,"Ġimplement":2280,"sh":2281,"AR":2282,"Ġsolve":2283,"Ġmathemat":2284,"Ġissues":2285,"OR":2286,"Ġpay":2287,"Ġmom":2288,"Ġhold":2289,"Ġhead":2290,"````":2291,"Ġcoll":2292,"Ġrequired":2293,"itude":2294,"Ġcells":2295,"Ġprofess":2296,"Ġposition":2297,"obal":2298,"âĪĴ":2299,"Ġfull":2300,"Ġloss":2301,"Ġshows":2302,"You":2303,"ĠĠĠĠĠĠ":2304,"Ġmultiple":2305,"alf":2306,"ustom":2307,"Ġpredict":2308,"ians":2309,"Ġeither":2310,"³³³³³³³³":2311,"Ġcause":2312,"Ġlay":2313,"'re":2314,"âĢľ":2315,"Ġkind":2316,"Ġreally":2317,"ked":2318,"wh":2319,"Ġdefin":2320,"oura":2321,"ĠAll":2322,"Ġreason":2323,"Ġselect":2324,"So":2325,"Ġhelps":2326,"aves":2327,"Ġdays":2328,"Ġintrodu":2329,"rams":2330,"\\$":2331,"atives":2332,"aut":2333,"ixed":2334,"Ġvariables":2335,"Ġsolutions":2336,"Ġuntil":2337,"ensity":2338,"Ġlittle":2339,"Ġcases":2340,"Ġenough":2341,"use":2342,"met":2343,"Ġphysical":2344,"Ġcheck":2345,"Ġbro":2346,"Ġmind":2347,"Ġresources":2348,"oh":2349,"rict":2350,"oney":2351,"umber":2352,")^":2353,"ĠUniversity":2354,"side":2355,"Ġnear":2356,"Ġbegin":2357,"playstyle":2358,"98":2359,"Ġreport":2360,"rel":2361,"Ġbal":2362,"Ġexplore":2363,"arr":2364,"Ġprim":2365,"omial":2366,"Ġscient":2367,"arget":2368,"Ġearly":2369,"Ġmach":2370,"urns":2371,"****":2372,"Ġteam":2373,"ones":2374,"ĠSim":2375,"Ġemploy":2376,"Ġangle":2377,"ajor":2378,"Ġturn":2379,"Ġbig":2380,"ising":2381,"atter":2382,"Ġnormal":2383,"ĠAdd":2384,"Ġassociated":2385,"sequ":2386,"55":2387,"Ġonline":2388,"Ġtoday":2389,"ruction":2390,"Ġestim":2391,"ĠSu":2392,"Ġsitu":2393,"ometimes":2394,"Ġevalu":2395,"ules":2396,"sqrt":2397,"Ġdifficult":2398,"Ġdraw":2399,"cd":2400,"Ġcru":2401,"78":2402,"ush":2403,"Ġcalculate":2404,"Ġtheory":2405,"AL":2406,"gen":2407,"Ġprec":2408,"inking":2409,"Ġfund":2410,"rame":2411,"Ġexperim":2412,"agine":2413,"Ġelement":2414,"inci":2415,"sy":2416,".)":2417,"Ġdone":2418,"astic":2419,"Ġcommunity":2420,"Ġenh":2421,"orn":2422,"ises":2423,"Ġage":2424,"Ġstress":2425,"Ġallows":2426,"ĠThen":2427,"roll":2428,"====":2429,"Ġblood":2430,"Ġgroups":2431,"Ġsample":2432,"96":2433,"Ġconcer":2434,"Ġeffects":2435,"osp":2436,"Ġquality":2437,"ming":2438,"ĠMath":2439,"respond":2440,"Ġclose":2441,"32":2442,"though":2443,"Ġmarket":2444,"ordin":2445,"ales":2446,"Ġaffect":2447,"displaystyle":2448,"aken":2449,"Ġmaterials":2450,"mon":2451,"part":2452,"alle":2453,"ĠStud":2454,"new":2455,"Ġprevious":2456,"ĠCont":2457,"acy":2458,"ounds":2459,"Ġopportun":2460,"Re":2461,"Ġax":2462,"ĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠ":2463,"=\\":2464,"Ġpast":2465,"Ġdefined":2466,"$.":2467,"uit":2468,"ript":2469,"eration":2470,"ĠSol":2471,"Ġaddition":2472,"ĠBe":2473,"ĠÃĹ":2474,"When":2475,"Ġbase":2476,"II":2477,"Ġheat":2478,"Ġerror":2479,"pha":2480,"mathrm":2481,"Ġprovides":2482,"Ġexplain":2483,"Ġconsum":2484,"ply":2485,"Ġdisease":2486,"Ġpersonal":2487,"ney":2488,"anks":2489,"Ġalgorithm":2490,"Ġwind":2491,"Ġmodels":2492,"ĠSome":2493,"Con":2494,"Ġcondition":2495,"ring":2496,"ĠMod":2497,"Ġsubject":2498,"ĠInt":2499,"Ġpie":2500,"aches":2501,"Ġassum":2502,"Ġapprox":2503,"ĠEqu":2504,"come":2505,"Ġcritical":2506,"Ġsource":2507,"Ġusually":2508,"eta":2509,"bit":2510,"Ġtechniques":2511,"}{\\":2512,"selves":2513,"Ġreduce":2514,"ĠEar":2515,"Ġver":2516,"onse":2517,"fact":2518,"Ġinstead":2519,"ĠAss":2520,"Ġtransform":2521,"Ġlo":2522,"Ġengine":2523,"Ġpopulation":2524,"46":2525,"Ġeffective":2526,"°":2527,"amples":2528,"Ġcannot":2529,"urity":2530,"Ġsomeone":2531,"Ġmechan":2532,"egin":2533,"Ġey":2534,"Ġrecogn":2535,"outh":2536,"Ġdetermine":2537,"ĠâĢĶ":2538,"unction":2539,"ening":2540,"Ġwrite":2541,"Ġarticle":2542,"ĠPr":2543,"Ġtowards":2544,"Ġmajor":2545,"aling":2546,"ĠDis":2547,"Ġcollect":2548,"Ġground":2549,"ST":2550,"05":2551,"Ġgreater":2552,"Ġchallenges":2553,"Ġlot":2554,"af":2555,"aries":2556,"pecially":2557,"Ġsoft":2558,"Ġtell":2559,"Ġcomes":2560,"ocity":2561,"Ġlines":2562,"Ġactually":2563,"Ġneeded":2564,"Ġaway":2565,"Ġplant":2566,"Ġnecessary":2567,"Ġsense":2568,"ĠDes":2569,"Ġoriginal":2570,"76":2571,"Ġactivities":2572,"Ġrather":2573,"Ġwomen":2574,"Ġimage":2575,"ĠBl":2576,"Ġeducation":2577,"ĠNe":2578,"Ġquick":2579,"ips":2580,"cal":2581,"Let":2582,"Ġcrucial":2583,"Ġden":2584,"plies":2585,"Ġjour":2586,"ipp":2587,"df":2588,"Ġupon":2589,"clusion":2590,"Ġcorrespond":2591,"Ġrot":2592,"Ġut":2593,"ĠNo":2594,"EN":2595,"ift":2596,"ott":2597,"ene":2598,"Ġemb":2599,"pre":2600,"ius":2601,"cular":2602,"lt":2603,"AN":2604,"Ġtools":2605,"Ġaspect":2606,"Ġpolic":2607,"iver":2608,"Ġdirection":2609,"Ġrelated":2610,"atory":2611,"Ġvir":2612,"Ġestab":2613,"Ġvel":2614,"39":2615,"ready":2616,"Ġmanagement":2617,"Ġincreasing":2618,"Ġeasy":2619,"ina":2620,"ĠDo":2621,"Ġconsid":2622,"lease":2623,"Ġidea":2624,"ĠUS":2625,"Ġever":2626,"une":2627,"Ġdam":2628,"onal":2629,"Ġgain":2630,"',":2631,"Ġwhole":2632,"ii":2633,"Ġcut":2634,"Ġnature":2635,"earch":2636,"ches":2637,"Ġprotect":2638,"Ġcolum":2639,"Ġregular":2640,"Ġevent":2641,"eb":2642,"Ġfrequency":2643,"Ġgame":2644,"ĠPer":2645,"Ġlikely":2646,"Ġheart":2647,"Ġregard":2648,"Ġidentify":2649,"ery":2650,"Ġconsist":2651,"³³³":2652,"ĠAmerican":2653,"fect":2654,"ouble":2655,"Ġhtt":2656,"nov":2657,"Ġshare":2658,"Ġindepend":2659,"Ġprice":2660,"cre":2661,"Ġ**":2662,"Ġparts":2663,"Ġ40":2664,"edi":2665,"Ġmeaning":2666,"Ġliter":2667,"Ġexpression":2668,"Ġadj":2669,"Ġcontext":2670,"Ġvolume":2671,"SE":2672,"ĠEm":2673,"Ġstreng":2674,"Qu":2675,"Ġsection":2676,"wise":2677,"Ġarr":2678,"Ġdoesn":2679,"Ġemot":2680,"Ġtarget":2681,"\\)":2682,"sum":2683,"Ġtas":2684,"aching":2685,"Ġcustom":2686,"Ġsepar":2687,"Ġrelative":2688,"lex":2689,"Ġball":2690,"ulations":2691,"Ġratio":2692,"lation":2693,"Ġproduction":2694,"Ġcal":2695,"Ġdeep":2696,"Ġalready":2697,"Ġ$$\\":2698,"ĠCalcul":2699,"nderstand":2700,"IC":2701,"ĠSe":2702,"Ġlimit":2703,"Ġbit":2704,"ancial":2705,"Ġaccording":2706,"Ġonce":2707,"Ġroot":2708,",\"":2709,"Ġparent":2710,"ĠFind":2711,"Ġgives":2712,"Ġpatients":2713,"Ġland":2714,"Ġdivid":2715,"reg":2716,"Ġsteps":2717,"Ġgrad":2718,"enge":2719,"Ġlab":2720,"Ġbrain":2721,"Ġproducts":2722,"Ġconver":2723,"Ġnever":2724,"like":2725,"à¤":2726,"based":2727,"Ġhours":2728,"oll":2729,"de":2730,"AC":2731,"iction":2732,"ĠMore":2733,"Ġdimens":2734,"Ġchem":2735,"Ġstory":2736,"inter":2737,"ĠMay":2738,"Ġuses":2739,"iency":2740,"Ġscience":2741,"Ġespecially":2742,"ged":2743,"Ġlater":2744,"Ġparticip":2745,"Ġport":2746,"ĠMan":2747,"Ġtravel":2748,"Ġhistor":2749,"Ġbreak":2750,"aim":2751,"light":2752,"sin":2753,"Ġfail":2754,"47":2755,"bl":2756,"imately":2757,"Ġexerc":2758,"Ġcontent":2759,"uted":2760,"Ġrecord":2761,"Ġsymbol":2762,"Ġapplications":2763,"pot":2764,"$,":2765,"ze":2766,"Ġthroughout":2767,"Ġoverall":2768,"Ġyoung":2769,"88":2770,"Ġprinci":2771,"Ġfigure":2772,"ey":2773,"Ġpolit":2774,"pri":2775,"Ġarray":2776,"know":2777,"igen":2778,"Ġ21":2779,"Ġmodern":2780,"'ll":2781,"Ġactivity":2782,"onstr":2783,"Ġconsidered":2784,"ĠPre":2785,"Ġtaking":2786,"Ġseen":2787,"}$$":2788,"ump":2789,"Ġstudies":2790,"Ġcolor":2791,"Ġsuper":2792,"ĠâĨ":2793,"Ġsimply":2794,"Wh":2795,"Ġload":2796,"rist":2797,"time":2798,"rack":2799,"hold":2800,"Ġavoid":2801,"Ġglobal":2802,"Ġunits":2803,"yl":2804,"Ġfall":2805,"]]":2806,"Ġproperties":2807,"49":2808,"Ġfit":2809,"Ġcomponents":2810,"Ġbehavior":2811,"Ġaltern":2812,"65":2813,"Ġassess":2814,"Ġinstance":2815,"Ġmaximum":2816,"Ġ%":2817,"Ġrow":2818,"pose":2819,"Ġgas":2820,"uck":2821,"Ġshape":2822,"Ġmoment":2823,"Ġbasic":2824,"elling":2825,"tex":2826,"struct":2827,"fully":2828,"Ġ60":2829,"Ġdoc":2830,"Ġ?":2831,"ging":2832,"Ġred":2833,"Ġhowever":2834,"Ġreflect":2835,"Ġtakes":2836,"ĠCons":2837,"Ġharm":2838,"Ġpair":2839,"Ġspecies":2840,"da":2841,"odes":2842,"opy":2843,"Ġhalf":2844,"Ġresponse":2845,"Ġvelocity":2846,"Ġmoney":2847,"Ġcoe":2848,"One":2849,"Ġthought":2850,"Ġetc":2851,"begin":2852,"Ġdiag":2853,"Ġwritten":2854,"Ġinteract":2855,"zz":2856,"Ġcos":2857,"Ġdynam":2858,"ison":2859,"Ġcapac":2860,"Ġteac":2861,"31":2862,"most":2863,"Ġentire":2864,"go":2865,"ores":2866,"ĠNow":2867,"ĠWhile":2868,"Ġnetwork":2869,"Ġtraining":2870,"Ġability":2871,"Ġbuilding":2872,"Ġsays":2873,"Ġ->":2874,"ĠHere":2875,"Ġevents":2876,"tage":2877,"allel":2878,"Ġprint":2879,"Ġsust":2880,"Ġdoing":2881,"Ġcompany":2882,"Ġcross":2883,"urope":2884,"77":2885,"Ġ\\\\":2886,"Ġitem":2887,"urs":2888,"ĠMed":2889,"tr":2890,"thon":2891,"Ġvalu":2892,"ĠYour":2893,"Ġbar":2894,"Ġhor":2895,"Ġwar":2896,"osts":2897,"rior":2898,"Ġincreased":2899,"way":2900,"Ġphot":2901,"vant":2902,"IT":2903,"Ġcreating":2904,"uments":2905,"Ġauthor":2906,"Ġdecre":2907,"'m":2908,"Ġnut":2909,"Im":2910,"aced":2911,"Ġprovided":2912,"Ġelectric":2913,"inally":2914,"Ġmeet":2915,"imals":2916,"Ġdemonstr":2917,"Ġexc":2918,"Ġtraditional":2919,"Ġitself":2920,"reci":2921,"Ġwide":2922,"roduction":2923,"ID":2924,"Ġstates":2925,"Ġbenefits":2926,"illed":2927,"Ġexamples":2928,"arrow":2929,"Ġsustain":2930,"Ġoffer":2931,"ares":2932,"ites":2933,"ptoms":2934,"orpor":2935,"Ġcomputer":2936,"Ġthera":2937,"Ġste":2938,"sych":2939,"Ġexperiences":2940,"reen":2941,"Ġpractices":2942,"Ġ22":2943,"overed":2944,"aily":2945,"Ġmatter":2946,"itor":2947,"Ġmess":2948,"wo":2949,"order":2950,"org":2951,"point":2952,"Ġstudent":2953,"AS":2954,"Ġgovernment":2955,"ĠCent":2956,"Ġexactly":2957,"sec":2958,"ĠNot":2959,"def":2960,"bon":2961,"Ġstra":2962,"Ġfeed":2963,"Ġintern":2964,"Ġfollows":2965,"Ġshap":2966,"emic":2967,"izes":2968,"ctors":2969,"Ġlooking":2970,"mathbf":2971,"plication":2972,"Ġfamil":2973,"Ġyet":2974,"Ġtaken":2975,"Ġvide":2976,"Ġsmo":2977,"Ġvert":2978,"Ġmen":2979,"Ġstrategies":2980,"Ġalgebra":2981,"Ġframe":2982,"rees":2983,"Ġthing":2984,"Ġbecomes":2985,"64":2986,"ĠFrom":2987,"eter":2988,"Ġrequires":2989,"ront":2990,"aste":2991,"ĠUse":2992,"âͼ":2993,"ĠDec":2994,"Ġcm":2995,"isions":2996,"Ġmicro":2997,"Ġsequence":2998,"IS":2999,"ĠApp":3000,"ĠMar":3001,"theta":3002,"ĠEurope":3003,"ned":3004,"ĠSystem":3005,"col":3006,"Ġappropri":3007,"Ġpopular":3008,"erve":3009,"85":3010,"Ġdigital":3011,"Ġparameters":3012,"Ġlink":3013,"Ġcountry":3014,"ĠShe":3015,"ĠReg":3016,"Ġaim":3017,"Ġrecomm":3018,"lim":3019,"ĠEarth":3020,"oles":3021,"Com":3022,"nomial":3023,"Ġplants":3024,"Ġlarger":3025,"Ġadapt":3026,"Ġ23":3027,"back":3028,"lo":3029,"Ġcreated":3030,"wers":3031,"ĠTrans":3032,"Ġoptim":3033,"hood":3034,"Ġemp":3035,"Ġinside":3036,"Ġaction":3037,"raft":3038,"97":3039,"ilt":3040,"Ġcoordin":3041,"Ġâī":3042,"ĠCO":3043,"Ġconduct":3044,"ĠAfter":3045,"Ġfive":3046,"ĠAm":3047,"ĠUnited":3048,"alpha":3049,"roup":3050,"By":3051,"ender":3052,"Ġsometimes":3053,"oph":3054,"Ġcompet":3055,"aving":3056,"gs":3057,"osing":3058,"isf":3059,"Ġdesigned":3060,"avor":3061,"Step":3062,"Ġguid":3063,"Ġfinancial":3064,"LE":3065,"])":3066,"Ġencoura":3067,"Ġmedical":3068,"Ġresearc":3069,"ustr":3070,"Ġregion":3071,"$\\":3072,"Ġann":3073,"Ġsimpl":3074,"igned":3075,"Ġeveryone":3076,"ION":3077,"Ġfinal":3078,"otal":3079,"Ġproduce":3080,"Ġelse":3081,"Ġsafe":3082,"RE":3083,"ĠAnal":3084,"AAAA":3085,"Ġobjects":3086,"Ġwave":3087,"Ġmembers":3088,"ometry":3089,"Ġuseful":3090,"terns":3091,"Ġvisual":3092,"Ġreview":3093,"Ġemerg":3094,"oon":3095,"Ġfeatures":3096,"Ġcultural":3097,"Ġprocesses":3098,"Ġreading":3099,"rical":3100,"Ġ28":3101,"ounter":3102,"Ġcontains":3103,"Ġblock":3104,"Ġface":3105,"Ġgot":3106,"blem":3107,"Ġcompared":3108,"Ġinnov":3109,"ĠComm":3110,"Ġones":3111,"leep":3112,"nderstanding":3113,"}^":3114,"Ġ]":3115,"Ġleading":3116,"Ġfriends":3117,"Ġsin":3118,"ĠGe":3119,"asc":3120,"Ġapply":3121,"Ġstop":3122,"Ġservices":3123,"Ġrev":3124,"plications":3125,"Ġcommunication":3126,"Ġheight":3127,"Ġago":3128,"Ġremember":3129,"Ġpage":3130,"ault":3131,"ĠStates":3132,"Ġwa":3133,"ype":3134,"ele":3135,"Ġdat":3136,"Ġcommunities":3137,"Ġpack":3138,"Ġapplied":3139,"ream":3140,"Ġweek":3141,"Ġcountries":3142,"Ġenvironmental":3143,"'ve":3144,"-\\":3145,"Ġsignal":3146,"ĠRep":3147,"Ġdeveloped":3148,"ĠAf":3149,"Ġthemselves":3150,"itation":3151,"orth":3152,"joy":3153,"itch":3154,"Ġpatterns":3155,"Ġequival":3156,"racy":3157,"array":3158,"ÃĹ":3159,"more":3160,"Ġdepend":3161,"ils":3162,"ĠCo":3163,"Ġsafety":3164,"Ġpropos":3165,"tic":3166,"Ġproced":3167,"ÏĢ":3168,"Ġforms":3169,"Ġconstruct":3170,"Ġrule":3171,"Ġclean":3172,"ĠRec":3173,"Ġjob":3174,"iddle":3175,"Ġapplication":3176,"Ġyourself":3177,"Ġur":3178,"yp":3179,"Ġautom":3180,"Ġsymptoms":3181,"Ġplot":3182,"Ġevidence":3183,"Ġexpect":3184,"Ġsides":3185,"Ġefficient":3186,"ground":3187,"Ġ26":3188,"ologies":3189,"Ġchoose":3190,"Ġslow":3191,"works":3192,"Ġuser":3193,"Ġcapt":3194,"ufact":3195,"Ġcub":3196,",\\":3197,"ĠÂłĠÂłĠÂłĠÂł":3198,"ceed":3199,"abilities":3200,"Ġhealthy":3201,"Ġ27":3202,"Ġwriting":3203,"ok":3204,"Ġsent":3205,"Ġparticularly":3206,"Ġsmaller":3207,"Ġminutes":3208,"56":3209,"yond":3210,"oly":3211,"ĠComp":3212,"acks":3213,"Ġderiv":3214,"Ġscale":3215,"hib":3216,"izations":3217,"Ġcontinue":3218,"Ġvoltage":3219,"arily":3220,"Ġincludes":3221,"icles":3222,"bda":3223,"print":3224,"Ġsearch":3225,"Ġaccur":3226,"Ġproperty":3227,"ĠSince":3228,"Ġcircle":3229,"Ġinvolves":3230,"Ġsubst":3231,"iol":3232,"ners":3233,"stry":3234,"}(":3235,"Ġeasily":3236,"ĠĠĠĠĠĠĠĠĠĠĠ":3237,"Ġculture":3238,"ĠAI":3239,"term":3240,"Ġappreci":3241,"Ġsoftware":3242,"Ġperfect":3243,"Ġtree":3244,"Ġtriangle":3245,"Ġweeks":3246,"alse":3247,"Ġlives":3248,"osis":3249,"ĠIntern":3250,"Ġadditional":3251,"pper":3252,"care":3253,"âĶģâĶģâĶģâĶģ":3254,"Ġcancer":3255,"ĠGu":3256,"Ġthus":3257,"Ġcontinuous":3258,"aged":3259,"Ġaccept":3260,"But":3261,"Ġ--":3262,"Ġdecision":3263,"Ġinterp":3264,"Cl":3265,"é":3266,"ĠPart":3267,"igma":3268,"Ġimportance":3269,"ĠAct":3270,"Ġlove":3271,"ension":3272,"Ġachieve":3273,"Ġlive":3274,"irm":3275,"Ġdirectly":3276,"load":3277,"Ġbox":3278,"ĠChrist":3279,"resents":3280,"Ġsets":3281,"Ġthird":3282,"rig":3283,"ector":3284,"Ġhyd":3285,"Ġprior":3286,"inite":3287,"Ġmental":3288,"eed":3289,"inct":3290,"Ġlonger":3291,"Ġcircuit":3292,"Ġliving":3293,"Ġresistance":3294,"itionally":3295,"Ġinvestig":3296,"Ġarch":3297,"Ġfost":3298,"cell":3299,"Ġsound":3300,"augh":3301,"Ġgetting":3302,"Ġisn":3303,"AB":3304,"Ġir":3305,"Ġrules":3306,"AM":3307,"Ġsal":3308,"Ġflo":3309,"Ġpict":3310,"Ġmachine":3311,"ription":3312,"Ġattention":3313,"ĠData":3314,"pite":3315,"Ġclimate":3316,"times":3317,"Ġtrying":3318,"Ġcateg":3319,"(\"":3320,"Ġmusic":3321,"Ġappropriate":3322,"vey":3323,"ED":3324,"Ġhouse":3325,"Ġcard":3326,"Ġmotion":3327,"Ġspread":3328,"log":3329,"adr":3330,"Ġskin":3331,"Ġproviding":3332,"Ġdensity":3333,"elta":3334,"ĠPM":3335,"Ġcontact":3336,"Ġcosts":3337,"Ġdegree":3338,"Ġadded":3339,"Ġ_":3340,"Ġconcent":3341,"ĠSub":3342,"ĠAb":3343,"43":3344,"ĠUsing":3345,"Ġcenter":3346,"06":3347,"Ġwond":3348,"Ġaud":3349,"ĠïĢ":3350,"duc":3351,"acc":3352,"inating":3353,"ðĿIJ":3354,"Ġenjoy":3355,"ĠFr":3356,"reme":3357,"Ġmonths":3358,"Ġclaim":3359,"ulate":3360,"encies":3361,"Ġbalance":3362,"Ġsatisf":3363,"ĠTherefore":3364,"Ġsociety":3365,"pec":3366,"olar":3367,"Ġsources":3368,"Ġâ̦":3369,"Ġcurve":3370,"na":3371,"cdot":3372,"42":3373,"hel":3374,"Ġprote":3375,"ibr":3376,"Ġmor":3377,"Ġbehind":3378,"ĠThus":3379,"xi":3380,"Ġthinking":3381,"ened":3382,"Ġoperations":3383,"Ġstories":3384,"erences":3385,"Here":3386,"CT":3387,"Ġaccel":3388,"Ġexpected":3389,"Ġvaluable":3390,"86":3391,"ĠAp":3392,"hesis":3393,"Ġindustry":3394,"Ġtherefore":3395,"mod":3396,"pid":3397,"Ġsignificantly":3398,"RO":3399,"ĠâĨĴ":3400,"Ġ2010":3401,"ĠTechn":3402,"Ġdaily":3403,"ults":3404,"Ġparallel":3405,"att":3406,"Ġrelig":3407,"Ġrepresents":3408,"ĠInte":3409,"Ġvia":3410,"Ġ${\\":3411,"Ġstrength":3412,"ecause":3413,"Ġquite":3414,"Ġmole":3415,"gers":3416,"ĠEach":3417,"sub":3418,"Ġideas":3419,"Ġ{\\":3420,"ĠDr":3421,"Ġextra":3422,"ĠSec":3423,"urb":3424,"ured":3425,"Ġeconomic":3426,"itable":3427,"Ġwal":3428,"ĠAre":3429,"Ġsun":3430,"ronic":3431,"Ġfeet":3432,"icial":3433,"fort":3434,"Ġopportunities":3435,"ĠPy":3436,"ĠFirst":3437,"ĠGo":3438,"rand":3439,"Ġsurround":3440,"Ġmeasures":3441,"Ġpriv":3442,"Ġinvolved":3443,"Ġinform":3444,"cient":3445,"ancing":3446,"nswer":3447,"Ġblack":3448,"Ġmoving":3449,"xy":3450,"Ġbeyond":3451,"Ġdeb":3452,"Ġmillion":3453,"ĠAcc":3454,"lear":3455,"Ġ2012":3456,"Ġhistorical":3457,"ĠHealth":3458,"Ġindex":3459,"ĠCar":3460,"Ġcalculated":3461,"Ġconcepts":3462,"Ġversion":3463,"porary":3464,"Ġsite":3465,"Ġord":3466,"Ġ==":3467,"raw":3468,"Ġfile":3469,"ung":3470,"ĠInter":3471,"Ġprogress":3472,"Ġfu":3473,"ided":3474,"do":3475,"rite":3476,"Ġadjust":3477,"Ġdefinition":3478,"Ġoutside":3479,"ĠAfric":3480,"isms":3481,"Ġaware":3482,"ometric":3483,"Ġstarted":3484,"mber":3485,"ĠPhys":3486,"ows":3487,"Ġful":3488,"Ġcat":3489,"ched":3490,"ithms":3491,"ET":3492,"Ġcolumn":3493,"Ġtypically":3494,"iring":3495,"Ġobtained":3496,"ler":3497,"ios":3498,"ried":3499,"atform":3500,"Ġpromot":3501,"08":3502,"avig":3503,"Ġmiss":3504,"Ġoptions":3505,"Ġproof":3506,"ensive":3507,"Ġ@":3508,"ĠEnglish":3509,"ĠLear":3510,"Ġrelationships":3511,"Ġresearchers":3512,"Ġcool":3513,"Ġstay":3514,"ocks":3515,"ĠTest":3516,"ĠScience":3517,"Ġbring":3518,"Ġrights":3519,"Ġvers":3520,"Ġwhose":3521,"::":3522,"Ġindependent":3523,"Ġ2011":3524,"ĠThrough":3525,"Ġund":3526,"Ġpolynomial":3527,"Un":3528,"Ġwebs":3529,"Ġlif":3530,"Ġeth":3531,"Ġ^":3532,"Ġrates":3533,"mar":3534,"Ġcompan":3535,"ai":3536,"02":3537,"ĠPar":3538,"Ġoffers":3539,"#####":3540,"Ġfast":3541,"Ġwrong":3542,"ĠRem":3543,"idth":3544,"Ġprimary":3545,"rect":3546,"Ġphase":3547,"ĠForm":3548,"Ġmedia":3549,"On":3550,"Ġremov":3551,"Ġrob":3552,"Ġmanufact":3553,"Ġchemical":3554,"Ġsoil":3555,"Ġprime":3556,"Ġ2013":3557,"Ġbasis":3558,"57":3559,"Ġperspect":3560,"Ġtax":3561,"Ġminim":3562,"mb":3563,"amin":3564,"Ġcentury":3565,"ĠGod":3566,"Ġissue":3567,"Ġcou":3568,"Ġquickly":3569,"Ġgreen":3570,"Ġbeaut":3571,"Ġstraight":3572,"ĠAM":3573,"uth":3574,"NA":3575,"iles":3576,"Ġdemand":3577,"Ġanimals":3578,"58":3579,"Ġinsp":3580,"Ġmathematical":3581,"Ġfixed":3582,"Ġlands":3583,"Ġspir":3584,"Ġhypot":3585,"Ġeverything":3586,"tempt":3587,"beta":3588,"Ġwhite":3589,"04":3590,"Ġmedic":3591,"_{\\":3592,"Ġincorpor":3593,"ĠÐ":3594,"67":3595,"Ġdiet":3596,"ĠMy":3597,"(-":3598,"Ġnote":3599,"++":3600,"Ġplane":3601,"www":3602,"Ġpatient":3603,"Sh":3604,"iar":3605,"Ġbroad":3606,"ached":3607,"And":3608,"Ġdescribed":3609,"uly":3610,"enced":3611,"hens":3612,"ĠClass":3613,"Ġdamage":3614,"Ġreact":3615,"oud":3616,"Ġsix":3617,"Ġsecurity":3618,"li":3619,"ĠJan":3620,"Ġjourney":3621,"Ġmultip":3622,"+\\":3623,"ster":3624,"Ġsleep":3625,"ĠJoh":3626,"oined":3627,"ilit":3628,"ffect":3629,"Ġinfluence":3630,"Ġdocument":3631,"________________":3632,"Ġcollabor":3633,"Ġpolitical":3634,"Ġdru":3635,"ervation":3636,"ĠNational":3637,"Ġdevices":3638,"ĠSch":3639,"heet":3640,"Ġdog":3641,"Ġdouble":3642,"ops":3643,"ĠMult":3644,"ublic":3645,"Ġconnected":3646,"Ġdiagn":3647,"Ġidentity":3648,"Ġreve":3649,"ĠWorld":3650,"oman":3651,"Ġpsych":3652,"Ġwall":3653,"Ġcompar":3654,"mission":3655,"Ġadvant":3656,"my":3657,"Ġprograms":3658,"eral":3659,"Ġproport":3660,"ections":3661,"Ġdeath":3662,"uration":3663,"Ġcover":3664,"Ġparameter":3665,"Ġvideo":3666,"Ġaspects":3667,"Ġforces":3668,"Ġdiverse":3669,"94":3670,"Ġservice":3671,"ĠAc":3672,"Ġ2009":3673,"mathbb":3674,"\".":3675,"Ġchapter":3676,"ĠResearch":3677,"Ġstatement":3678,"Ġinteger":3679,"Ġalmost":3680,"gest":3681,"Ġheav":3682,"enn":3683,"Ġincreases":3684,"Ġmovement":3685,"Ġdegrees":3686,"Ġ\\(\\":3687,"Ġupd":3688,"off":3689,"ĠDef":3690,"ĠState":3691,"Ġcontribute":3692,"Ġefficiency":3693,"ography":3694,"AP":3695,"Ġremains":3696,"Ġfoot":3697,"Ġprep":3698,"Ġfinding":3699,"with":3700,"ĠMathemat":3701,"Ġcity":3702,"Ġcorresponding":3703,"comes":3704,"Ġrecent":3705,"Ġdest":3706,"ĠĠĠĠĠĠĠĠĠ":3707,"Chapter":3708,"07":3709,"head":3710,"Ġhab":3711,"Ġfraction":3712,"Ġpowerful":3713,"93":3714,"Ġmention":3715,"03":3716,"68":3717,"Ġer":3718,"ĠâĪĪ":3719,"ractions":3720,"Ġstructures":3721,"Ġvalid":3722,"ae":3723,"Ġmemory":3724,"Ġusers":3725,"rs":3726,"imin":3727,"Ġbott":3728,"urrent":3729,"dom":3730,"Ġbecame":3731,"mu":3732,"ĠDi":3733,"Ġreach":3734,"Ġstarting":3735,"Ġminimum":3736,"Ġchoice":3737,"41":3738,"Ġtests":3739,"Ġfat":3740,"Ġsubt":3741,"Ġactual":3742,"Ġdifferences":3743,"ĠAN":3744,"ifically":3745,"ching":3746,"Ġseems":3747,"ĠJust":3748,"erent":3749,"Ġdisplay":3750,"Ġcompre":3751,"ifying":3752,"ĠAg":3753,"ĠMon":3754,"Ġcomponent":3755,"osure":3756,"Ġdefine":3757,"Ġexploring":3758,"Ġequivalent":3759,"Ġodd":3760,"vere":3761,"ĠSupp":3762,"phas":3763,"``````":3764,"EM":3765,"Ġdevice":3766,"Ġpan":3767,"Ġreference":3768,"Ġ2008":3769,"Ġask":3770,"amma":3771,"Ġyield":3772,"Ġcontroll":3773,"Ġutil":3774,"ulated":3775,"ĠExpl":3776,"Ġrefer":3777,"uff":3778,"Ġgrav":3779,"Ġconc":3780,"ĠGener":3781,"partial":3782,"osite":3783,"ĠFigure":3784,"Ġplatform":3785,"Ġla":3786,"ĠEd":3787,"tical":3788,"}}\\":3789,"Ġimages":3790,"ĠOct":3791,"big":3792,"Ġcauses":3793,"Example":3794,"Ġbelieve":3795,"onic":3796,"Ġsex":3797,"Ġoil":3798,"ĠOf":3799,"Ġrepe":3800,"Ġ90":3801,"hing":3802,"Section":3803,"Ġcame":3804,"Ġsituation":3805,"ourse":3806,"Ġkg":3807,"eterm":3808,"que":3809,"ĠSep":3810,"ĠOver":3811,"][":3812,"ogle":3813,"Ġult":3814,"olute":3815,"At":3816,"see":3817,"Ġresid":3818,"Ġbooks":3819,"book":3820,"Ġbuy":3821,"Ġinteresting":3822,"Ġgenerally":3823,"PS":3824,"Ġtesting":3825,"Ġintegral":3826,"Ġexpon":3827,"Ġsupply":3828,"ĠVal":3829,"Ġmap":3830,"ley":3831,"Ġ29":3832,"ameter":3833,"Ġcommit":3834,"olic":3835,"ishing":3836,"Ġeffectively":3837,"Ġefforts":3838,"Ġcharge":3839,"ellig":3840,"IV":3841,"Ġ;":3842,"rote":3843,"Ġtheorem":3844,"Ġstru":3845,"ĠDep":3846,"Figure":3847,"eds":3848,"Ġfundam":3849,"su":3850,"Ġinterval":3851,"Ġgoes":3852,"Ġoption":3853,"ĠExample":3854,"ternal":3855,"Ġvariety":3856,"Ġdetails":3857,"Ġsort":3858,"Ġspect":3859,"umb":3860,"Ġestimate":3861,"Ġanswers":3862,"Ġhoriz":3863,"Ġexperiment":3864,"Ġ${":3865,"ams":3866,"ĠMin":3867,"Ġsurv":3868,"OT":3869,"phi":3870,"aneous":3871,"edu":3872,"Ġextreme":3873,"Ġrect":3874,"che":3875,"Ġattempt":3876,"bre":3877,"Ġresulting":3878,"Ġitems":3879,"pling":3880,"ivil":3881,"Ġgoal":3882,"lambda":3883,"anation":3884,"Ġinsights":3885,"mm":3886,"Ġensuring":3887,"itle":3888,"Ġdeveloping":3889,"gment":3890,"lor":3891,"known":3892,"Ġexercise":3893,"US":3894,"ĠInst":3895,"}}{":3896,"artment":3897,"ĠRel":3898,"ags":3899,"Ġoperation":3900,"09":3901,"Ġ~":3902,"ork":3903,"estions":3904,"Ġbond":3905,"ormal":3906,"ĠMany":3907,"ĠArt":3908,"Ġtransfer":3909,"Ġinstall":3910,"Ġexcept":3911,"lege":3912,"odies":3913,"Ġinj":3914,"Ġillustr":3915,"Ġcarbon":3916,"Ġearth":3917,"Ġfasc":3918,"ĠComput":3919,"Ġmis":3920,"Ġfields":3921,"DE":3922,"lict":3923,"Ġ//":3924,"ference":3925,"max":3926,"Ġlocation":3927,"Ġallowing":3928,"Ġstring":3929,"linear":3930,"gram":3931,"ĠPe":3932,"Ġwin":3933,"ighb":3934,"ĠII":3935,"iable":3936,"which":3937,"Ġdistinct":3938,"Ġenhance":3939,"Ġpattern":3940,"aff":3941,"ĠHist":3942,"ipment":3943,"Ġreduced":3944,"Ġscen":3945,"Ġveh":3946,"opt":3947,"Ġearl":3948,"Ġaxis":3949,"})":3950,"((":3951,"];":3952,"ese":3953,"Ġrespectively":3954,"²":3955,"amed":3956,"word":3957,"raint":3958,"ĠAB":3959,"Ġforward":3960,"omin":3961,"Ġscientific":3962,"Ġgrowing":3963,"Ġsolid":3964,"uracy":3965,"osition":3966,"change":3967,"room":3968,"ĠNumber":3969,"value":3970,"Ġoutcomes":3971,"Question":3972,"Ġprinciples":3973,"asons":3974,"!!":3975,"Ġ35":3976,"ĠNum":3977,"Ġincluded":3978,"................":3979,"Ġradius":3980,"Ġtook":3981,"ober":3982,"stitute":3983,"ĠĊ":3984,"ĠOur":3985,"Ġagree":3986,"oday":3987,"overy":3988,"Ġtrend":3989,"Ġlayer":3990,"Ġsolving":3991,"Ġ<-":3992,"Ġcred":3993,"ĠWar":3994,"87":3995,"Ġactive":3996,"Ġalternative":3997,"iform":3998,"Ġcaused":3999,"ĠAug":4000,"Ġcapacity":4001,"Is":4002,"Ġnavig":4003,"rier":4004,"ĠChe":4005,"ĠCre":4006,"Ġtransport":4007,"Ġparents":4008,"Ġfem":4009,"Ġlimited":4010,"Ġeasier":4011,"temporary":4012,"Ġbuilt":4013,"rown":4014,"Ġfair":4015,"Ġpurpose":4016,"Ġcompanies":4017,"acters":4018,"vest":4019,"Ġangles":4020,"ĠIN":4021,"Ġfriend":4022,"Ġprofessional":4023,"ĠFurther":4024,"Ġ45":4025,"Ġbur":4026,"ellow":4027,"iber":4028,"istry":4029,"Ġhealthcare":4030,"ancy":4031,"Ġliqu":4032,"ĠCal":4033,"Int":4034,"Ġtrig":4035,"Ġimmedi":4036,"Ġprobably":4037,"oration":4038,"ĠLevel":4039,"Ġasked":4040,"cast":4041,"utor":4042,"Ġvary":4043,"Ġrout":4044,"Ġpiece":4045,"ha":4046,"illing":4047,"Ġanything":4048,"Ġrelevant":4049,"ĠOther":4050,"With":4051,"orrect":4052,"Ġthreat":4053,"Ġ2016":4054,"Ġobserved":4055,"ĠApr":4056,"ĠUnderstanding":4057,"Ġmeasurement":4058,"ĠTH":4059,"idge":4060,"Ġindustr":4061,"ls":4062,"haps":4063,"olve":4064,"cont":4065,"Ġproduced":4066,"inks":4067,"From":4068,"Ġnational":4069,"dx":4070,"Ġdecisions":4071,"Ġadding":4072,"ĠWell":4073,"Ġconvert":4074,"--------------------------------":4075,"Ġregarding":4076,"Ġcalculator":4077,"Ġedge":4078,"Ġcalculation":4079,"89":4080,"uzz":4081,"Ġapproaches":4082,"Ġfinite":4083,"itect":4084,"Ġgames":4085,"ĠLine":4086,"ror":4087,"Ġled":4088,"Ġprojects":4089,"Ġsuff":4090,"Ġhumans":4091,"Ġemphas":4092,"Ġ2015":4093,"Ġ2014":4094,"ĠOut":4095}