Skip to content

Commit

Permalink
Built site for gh-pages
Browse files Browse the repository at this point in the history
  • Loading branch information
ohmeow committed Jul 3, 2024
1 parent 846b0e5 commit 6c7185d
Show file tree
Hide file tree
Showing 6 changed files with 13 additions and 22 deletions.
2 changes: 1 addition & 1 deletion .nojekyll
Original file line number Diff line number Diff line change
@@ -1 +1 @@
68a5bb20
49c9c303
4 changes: 2 additions & 2 deletions index.html
Original file line number Diff line number Diff line change
Expand Up @@ -296,7 +296,7 @@ <h5 class="quarto-listing-category-title">Categories</h5><div class="quarto-list
</div>
</div>
<div class="list quarto-listing-default">
<div class="quarto-post image-right" data-index="0" data-categories="NLP,LLMS,datasets,learning,projects" data-listing-date-sort="1719990000000" data-listing-file-modified-sort="1720045845169" data-listing-date-modified-sort="NaN" data-listing-reading-time-sort="15" data-listing-word-count-sort="2866">
<div class="quarto-post image-right" data-index="0" data-categories="NLP,LLMS,datasets,learning,projects" data-listing-date-sort="1719990000000" data-listing-file-modified-sort="1720046228815" data-listing-date-modified-sort="NaN" data-listing-reading-time-sort="15" data-listing-word-count-sort="2866">
<div class="thumbnail">
<p><a href="./posts/2024-07-03-llm-workshop-intro.html" class="no-external"></a></p><a href="./posts/2024-07-03-llm-workshop-intro.html" class="no-external">
<p><img loading="lazy" src="./posts/images/blog-20240603/header.png" class="thumbnail-image"></p>
Expand Down Expand Up @@ -342,7 +342,7 @@ <h3 class="no-anchor listing-title">
15 min
</div>
<div class="metadata-value listing-file-modified">
7/3/24, 3:30:45 PM
7/3/24, 3:37:08 PM
</div>
</a>
</div>
Expand Down
6 changes: 3 additions & 3 deletions index.xml
Original file line number Diff line number Diff line change
Expand Up @@ -146,9 +146,8 @@ Tip 4: Build something
<p>The answer is you can’t without good evals, and good evals are something built up over time and a project in and of themselves. They aren’t static. Having a good system to build and continuously improve on them is one of the most important ways you can ensure you are delivering a quality AI solution.</p>
<p>Also, don’t forget to include human experts where possible!</p>
</section>
</section>
<section id="prove-you-need-to-finetune" class="level2">
<h2 class="anchored" data-anchor-id="prove-you-need-to-finetune">Prove You Need to Finetune</h2>
<section id="prove-you-need-to-finetune" class="level3">
<h3 class="anchored" data-anchor-id="prove-you-need-to-finetune">Prove You Need to Finetune</h3>
<blockquote class="blockquote">
<p><img src="https://ohmeow.com/posts/images/blog-20240603/hamel-icon.png" alt="Hamel" style="border-radius:30px;width:auto;height:25px;"> Try not to finetune first … you need to prove to yoruefl that you should finetune [using] some minimal evaluation system and you hit a wall and can’t make progress by just prompting</p>
</blockquote>
Expand All @@ -159,6 +158,7 @@ Tip 4: Build something
<li>Domain specific things that models like GPT and Claude haven’t been trained on</li>
</ol>
<p>The narrower the domain/problem … the better.</p>
</section>
<section id="dont-try-and-build-a-general-purpose-chatbot" class="level3">
<h3 class="anchored" data-anchor-id="dont-try-and-build-a-general-purpose-chatbot">Don’t Try and Build a General Purpose Chatbot</h3>
<p>Being asked to build a chatbot is a smell because the surface area is very large and unscoped, making it difficult to make progress on. We simply do not have the time, money, data, and resources companies like OpenAI and Anthropic have to make a chatbot that can perform as well as theirs in general … and no one wants to use an AltaVista like chatbot when you got Google.</p>
Expand Down
10 changes: 4 additions & 6 deletions posts/2024-07-03-llm-workshop-intro.html
Original file line number Diff line number Diff line change
Expand Up @@ -207,9 +207,7 @@ <h2 id="toc-title">On this page</h2>
<li><a href="#trust-fucking-no-one-tfno" id="toc-trust-fucking-no-one-tfno" class="nav-link" data-scroll-target="#trust-fucking-no-one-tfno">Trust fucking no one (TFNO)</a></li>
<li><a href="#look-at-your-data" id="toc-look-at-your-data" class="nav-link" data-scroll-target="#look-at-your-data">Look at your data</a></li>
<li><a href="#build-an-evals-first-development-mindset" id="toc-build-an-evals-first-development-mindset" class="nav-link" data-scroll-target="#build-an-evals-first-development-mindset">Build an Evals-First Development Mindset</a></li>
</ul></li>
<li><a href="#prove-you-need-to-finetune" id="toc-prove-you-need-to-finetune" class="nav-link" data-scroll-target="#prove-you-need-to-finetune">Prove You Need to Finetune</a>
<ul class="collapse">
<li><a href="#prove-you-need-to-finetune" id="toc-prove-you-need-to-finetune" class="nav-link" data-scroll-target="#prove-you-need-to-finetune">Prove You Need to Finetune</a></li>
<li><a href="#dont-try-and-build-a-general-purpose-chatbot" id="toc-dont-try-and-build-a-general-purpose-chatbot" class="nav-link" data-scroll-target="#dont-try-and-build-a-general-purpose-chatbot">Don’t Try and Build a General Purpose Chatbot</a></li>
<li><a href="#use-your-eval-pipeline-to-curate-training-datasets" id="toc-use-your-eval-pipeline-to-curate-training-datasets" class="nav-link" data-scroll-target="#use-your-eval-pipeline-to-curate-training-datasets">Use your Eval Pipeline to Curate Training Datasets</a></li>
<li><a href="#evallogging-tools-i-like-so-far" id="toc-evallogging-tools-i-like-so-far" class="nav-link" data-scroll-target="#evallogging-tools-i-like-so-far">Eval/Logging Tools I like (so far)</a></li>
Expand Down Expand Up @@ -389,9 +387,8 @@ <h3 class="anchored" data-anchor-id="build-an-evals-first-development-mindset">B
<p>The answer is you can’t without good evals, and good evals are something built up over time and a project in and of themselves. They aren’t static. Having a good system to build and continuously improve on them is one of the most important ways you can ensure you are delivering a quality AI solution.</p>
<p>Also, don’t forget to include human experts where possible!</p>
</section>
</section>
<section id="prove-you-need-to-finetune" class="level2">
<h2 class="anchored" data-anchor-id="prove-you-need-to-finetune">Prove You Need to Finetune</h2>
<section id="prove-you-need-to-finetune" class="level3">
<h3 class="anchored" data-anchor-id="prove-you-need-to-finetune">Prove You Need to Finetune</h3>
<blockquote class="blockquote">
<p><img src="images/blog-20240603/hamel-icon.png" alt="Hamel" style="border-radius:30px;width:auto;height:25px;"> Try not to finetune first … you need to prove to yoruefl that you should finetune [using] some minimal evaluation system and you hit a wall and can’t make progress by just prompting</p>
</blockquote>
Expand All @@ -402,6 +399,7 @@ <h2 class="anchored" data-anchor-id="prove-you-need-to-finetune">Prove You Need
<li>Domain specific things that models like GPT and Claude haven’t been trained on</li>
</ol>
<p>The narrower the domain/problem … the better.</p>
</section>
<section id="dont-try-and-build-a-general-purpose-chatbot" class="level3">
<h3 class="anchored" data-anchor-id="dont-try-and-build-a-general-purpose-chatbot">Don’t Try and Build a General Purpose Chatbot</h3>
<p>Being asked to build a chatbot is a smell because the surface area is very large and unscoped, making it difficult to make progress on. We simply do not have the time, money, data, and resources companies like OpenAI and Anthropic have to make a chatbot that can perform as well as theirs in general … and no one wants to use an AltaVista like chatbot when you got Google.</p>
Expand Down
Loading

0 comments on commit 6c7185d

Please sign in to comment.