# Blog Anyone who's worked with me knows the written word is not my strong point. Please enjoy the ideas presented here. ## Structure targets for small protein language models 25 October 2026 Eleven 7.4M-parameter protein encoders, identical except for the pretraining target, compared on secondary structure and fold retrieval. Regressing frozen ESM-IF1 structure embeddings with a linear head beat masked language modelling; predicting the same targets through a JEPA-style predictor did not. [Read](https://jacob-davies.com/blog/structure-taught-protein-models/) · [Interactive demo](https://jacob-davies.com/protein/) · [Paper](https://jacob-davies.com/papers/structure-taught-protein-models/) ## I want snow on my birthday 10 September 2026 It's more likely to snow in the UK at Easter than at Christmas, but I've never seen snow anywhere near my birthday at the start of April. I'd heard the statistics, but I don't think I had ever properly internalised what they actually meant. This interactive project allows you to understand what the climate should be like on any given day. [Read](https://jacob-davies.com/blog/climate-birthday/) · [Interactive demo](https://jacob-davies.com/climate-birthday/) ## Satellite-based edge-deployed AI 2 September 2026 Satellites can see far more of the world than they can transmit home, but with how versatile modern image processing AI can be, it has become possible to deploy a general AI model and allow end users to reduce the data they are paying for by running experiments on the satellite and only transmitting the results. [Read](https://jacob-davies.com/blog/satellite-vessel-detection/) · [Paper](https://jacob-davies.com/papers/satellite-vessel-detection/) ## Show me where the tumour is 21 May 2026 Brain tumour classifiers are already accurate, but none can yet prove it is accurate enough to trust as a black box, so I compared models on how well they explain their answers. [Read](https://jacob-davies.com/blog/brain_tumor_explainable_diagnoses/) · [Paper](https://jacob-davies.com/papers/brain_tumor_explainable_diagnoses/) ## The safest reason to quit an AI lab 20 May 2026 Whatever your real reason for leaving an AI lab, saying you're worried about the models is a dominant strategy. [Read](https://jacob-davies.com/blog/lab-exit-signalling/) ## Writing the missing manual for AI weather forecasts 14 May 2026 Machine learning has caught up with physics-based weather forecasting, but the weather services lack information on how to make this transition. For my undergraduate dissertation I conducted an empirical investigation on how best to develop future MLWP models. [Read](https://jacob-davies.com/blog/ai-weather-prediction/) · [Paper](https://jacob-davies.com/papers/ai-weather-prediction/)