feat: Trading Bot V1.8 - Aggressive Mode + Infrastructure

## Major Features - Session Filter: NY-only trading (13:00-21:00 UTC) - SQLite Database: Structured trade logging - Telegram Bot: Real-time notifications (@Xausd_digger_bot) - Streamlit Dashboard: Visual monitoring & analytics - JSON Import: Historical data migration ## Infrastructure - trading_database.py: SQLite trade storage - telegram_notifier.py: Telegram integration - infrastructure_patch.py: Combined DB + Telegram - trading_dashboard.py: Real-time web dashboard - import_json_to_db.py: JSON to SQLite migration ## Session Filter (V1.8 Aggressive Mode) - session_filter_patch.py: Whitelist-based filter - Blocks: Asian, London, Overlap sessions - Active: NY session only (best performance: 47.6% WR) - Base confidence: 60% ## Documentation - V1.8_AGGRESSIVE_MODE_AKTIVIERT.md - FIX_DUPLICATE_SCHEDULER.md - DASHBOARD_WINDOWS_SERVER.md - SQLITE_TELEGRAM_SETUP.md - PROJECT_CLEANUP.md ## Cleanup - Archived old V1.1-V1.7 versions - Removed obsolete analysis scripts (replaced by dashboard) - Added .gitignore for secrets and temp files ## Breaking Changes - Requires telegram_config.json (use template) - Requires Python packages: streamlit, plotly 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-26 21:14:01 +01:00
parent b61cb9b8f9
commit 596718e30b
64 changed files with 9944 additions and 78909 deletions
@@ -0,0 +1,279 @@
+# 🧹 Project Cleanup Guide
+
+## Aktuelle Projekt-Struktur
+
+### ✅ KEEP - Production Files (Aktiv genutzt)
+
+**Core Trading Bot:**
+- `TradingBot_V1.6_Adaptive_Complete_CORRECTED.ipynb` ⭐ Main notebook
+- `session_filter_patch.py` ⭐ Session filter (V1.8)
+- `infrastructure_patch.py` ⭐ Database + Telegram integration
+- `trading_database.py` ⭐ SQLite database
+- `telegram_notifier.py` ⭐ Telegram bot
+- `telegram_config.json` ⭐ Your credentials (KEEP PRIVATE!)
+- `trading_bot.db` ⭐ Your trade data
+
+**Dashboard & Tools:**
+- `trading_dashboard.py` ⭐ Streamlit dashboard
+- `import_json_to_db.py` ⭐ JSON import tool
+
+**Data:**
+- `trade_performance_v16_XAUUSD_202510.json` 📊 Historical data (October)
+- `trade_performance_v16_XAUUSD_202511.json` 📊 Historical data (November)
+
+**Documentation (Active):**
+- `V1.8_AGGRESSIVE_MODE_AKTIVIERT.md` 📖 Current version docs
+- `FIX_DUPLICATE_SCHEDULER.md` 📖 Critical fix guide
+- `DASHBOARD_WINDOWS_SERVER.md` 📖 Dashboard deployment
+- `SQLITE_TELEGRAM_SETUP.md` 📖 Infrastructure setup
+
+---
+
+### 📦 ARCHIVE - Old/Reference Files
+
+**Old Documentation (Superseded by V1.8):**
+- `V1.6_CORRECTED_Dokumentation.md` → Archive
+- `V1.7_SESSION_FILTER_AKTIVIERT.md` → Archive (now V1.8)
+- `SESSION_FILTER_INSTALLATION.md` → Archive (covered in V1.8 docs)
+- `CONFIDENCE_THRESHOLD_GUIDE.md` → Archive (info in session_filter_patch.py)
+- `TradingBot_V1.6_Verbesserungsvorschlaege.md` → Archive
+- `Implementierungsplan_V1.6_to_V2.0.md` → Archive
+
+**Development/Deployment Docs (Still useful but can be archived):**
+- `VPS_DEPLOYMENT_V1.8.md` → Keep or Archive (covered in DASHBOARD_WINDOWS_SERVER.md)
+- `DASHBOARD_VPS_DEPLOYMENT.md` → Archive (Windows version is newer)
+- `QUICK_START_INFRASTRUCTURE.md` → Archive (covered in SQLITE_TELEGRAM_SETUP.md)
+- `NOTEBOOK_FIX_TRADE_LOGGING.md` → Archive (fix already applied)
+
+**Analysis Scripts (Optional - can archive if not used):**
+- `analyze_mt5_profitability.py` → Archive (Dashboard does this now)
+- `analyze_performance.py` → Archive (Dashboard does this now)
+- `analyze_performance_simple.py` → Archive (Dashboard does this now)
+- `check_database_logs.py` → Archive (Dashboard replaced this)
+
+**Template:**
+- `telegram_config_template.json` → Keep (useful for setup on new systems)
+
+---
+
+## 🗂️ Recommended Folder Structure
+
+```
+placeorder/
+├── 📁 production/          # Active files
+│   ├── TradingBot_V1.6_Adaptive_Complete_CORRECTED.ipynb
+│   ├── session_filter_patch.py
+│   ├── infrastructure_patch.py
+│   ├── trading_database.py
+│   ├── telegram_notifier.py
+│   ├── trading_dashboard.py
+│   ├── import_json_to_db.py
+│   ├── telegram_config.json
+│   └── trading_bot.db
+│
+├── 📁 docs/                # Current documentation
+│   ├── V1.8_AGGRESSIVE_MODE_AKTIVIERT.md
+│   ├── FIX_DUPLICATE_SCHEDULER.md
+│   ├── DASHBOARD_WINDOWS_SERVER.md
+│   ├── SQLITE_TELEGRAM_SETUP.md
+│   └── telegram_config_template.json
+│
+├── 📁 data/                # Trade data
+│   ├── trade_performance_v16_XAUUSD_202510.json
+│   └── trade_performance_v16_XAUUSD_202511.json
+│
+└── 📁 archive/             # Old files
+    ├── docs/
+    │   ├── V1.6_CORRECTED_Dokumentation.md
+    │   ├── V1.7_SESSION_FILTER_AKTIVIERT.md
+    │   ├── SESSION_FILTER_INSTALLATION.md
+    │   ├── CONFIDENCE_THRESHOLD_GUIDE.md
+    │   ├── TradingBot_V1.6_Verbesserungsvorschlaege.md
+    │   ├── Implementierungsplan_V1.6_to_V2.0.md
+    │   ├── VPS_DEPLOYMENT_V1.8.md
+    │   ├── DASHBOARD_VPS_DEPLOYMENT.md
+    │   ├── QUICK_START_INFRASTRUCTURE.md
+    │   └── NOTEBOOK_FIX_TRADE_LOGGING.md
+    │
+    └── scripts/
+        ├── analyze_mt5_profitability.py
+        ├── analyze_performance.py
+        ├── analyze_performance_simple.py
+        └── check_database_logs.py
+```
+
+---
+
+## 🚀 Quick Cleanup Actions
+
+### Option 1: Manual Cleanup (Safest)
+
+```bash
+# Create folders
+mkdir -p production docs data archive/docs archive/scripts
+
+# Move production files
+mv TradingBot_V1.6_Adaptive_Complete_CORRECTED.ipynb production/
+mv session_filter_patch.py infrastructure_patch.py production/
+mv trading_database.py telegram_notifier.py production/
+mv trading_dashboard.py import_json_to_db.py production/
+mv telegram_config.json trading_bot.db production/
+
+# Move current docs
+mv V1.8_AGGRESSIVE_MODE_AKTIVIERT.md docs/
+mv FIX_DUPLICATE_SCHEDULER.md docs/
+mv DASHBOARD_WINDOWS_SERVER.md docs/
+mv SQLITE_TELEGRAM_SETUP.md docs/
+mv telegram_config_template.json docs/
+
+# Move data
+mv trade_performance_v16_XAUUSD_*.json data/
+
+# Archive old docs
+mv V1.6_CORRECTED_Dokumentation.md archive/docs/
+mv V1.7_SESSION_FILTER_AKTIVIERT.md archive/docs/
+mv SESSION_FILTER_INSTALLATION.md archive/docs/
+mv CONFIDENCE_THRESHOLD_GUIDE.md archive/docs/
+mv TradingBot_V1.6_Verbesserungsvorschlaege.md archive/docs/
+mv Implementierungsplan_V1.6_to_V2.0.md archive/docs/
+mv VPS_DEPLOYMENT_V1.8.md archive/docs/
+mv DASHBOARD_VPS_DEPLOYMENT.md archive/docs/
+mv QUICK_START_INFRASTRUCTURE.md archive/docs/
+mv NOTEBOOK_FIX_TRADE_LOGGING.md archive/docs/
+
+# Archive old scripts
+mv analyze_*.py archive/scripts/
+mv check_database_logs.py archive/scripts/
+```
+
+### Option 2: Simple Cleanup (Just Archive)
+
+```bash
+# Create archive folder
+mkdir -p archive
+
+# Move old files
+mv V1.6_CORRECTED_Dokumentation.md archive/
+mv V1.7_SESSION_FILTER_AKTIVIERT.md archive/
+mv SESSION_FILTER_INSTALLATION.md archive/
+mv CONFIDENCE_THRESHOLD_GUIDE.md archive/
+mv TradingBot_V1.6_Verbesserungsvorschlaege.md archive/
+mv Implementierungsplan_V1.6_to_V2.0.md archive/
+mv VPS_DEPLOYMENT_V1.8.md archive/
+mv DASHBOARD_VPS_DEPLOYMENT.md archive/
+mv QUICK_START_INFRASTRUCTURE.md archive/
+mv NOTEBOOK_FIX_TRADE_LOGGING.md archive/
+mv analyze_*.py archive/
+mv check_database_logs.py archive/
+```
+
+### Option 3: Aggressive Cleanup (Delete Archive)
+
+**⚠️ ONLY if you're sure you don't need old docs!**
+
+```bash
+# Delete old docs
+rm V1.6_CORRECTED_Dokumentation.md
+rm V1.7_SESSION_FILTER_AKTIVIERT.md
+rm SESSION_FILTER_INSTALLATION.md
+rm CONFIDENCE_THRESHOLD_GUIDE.md
+rm TradingBot_V1.6_Verbesserungsvorschlaege.md
+rm Implementierungsplan_V1.6_to_V2.0.md
+rm VPS_DEPLOYMENT_V1.8.md
+rm DASHBOARD_VPS_DEPLOYMENT.md
+rm QUICK_START_INFRASTRUCTURE.md
+rm NOTEBOOK_FIX_TRADE_LOGGING.md
+
+# Delete old scripts (replaced by dashboard)
+rm analyze_mt5_profitability.py
+rm analyze_performance.py
+rm analyze_performance_simple.py
+rm check_database_logs.py
+```
+
+---
+
+## 📋 Minimal Production Setup (What you NEED)
+
+For clean Windows Server deployment, you only need these files:
+
+**Essential Files (13 files):**
+```
+1. TradingBot_V1.6_Adaptive_Complete_CORRECTED.ipynb
+2. session_filter_patch.py
+3. infrastructure_patch.py
+4. trading_database.py
+5. telegram_notifier.py
+6. telegram_config.json
+7. trading_dashboard.py
+8. import_json_to_db.py (optional, for historical data)
+
+Documentation:
+9. V1.8_AGGRESSIVE_MODE_AKTIVIERT.md
+10. FIX_DUPLICATE_SCHEDULER.md
+11. DASHBOARD_WINDOWS_SERVER.md
+12. SQLITE_TELEGRAM_SETUP.md
+13. telegram_config_template.json
+```
+
+**Generated at Runtime:**
+- `trading_bot.db` (created by bot)
+- Performance JSON files (created by bot)
+
+---
+
+## 🎯 Recommendation
+
+**My Suggestion: Option 2 (Simple Archive)**
+
+1. Create `archive/` folder
+2. Move old docs/scripts there
+3. Keep everything accessible but organized
+4. Easy to reference if needed
+
+**Benefits:**
+- ✅ Clean main directory
+- ✅ Easy to find current files
+- ✅ Old docs still accessible
+- ✅ Safe (nothing deleted)
+
+**Execute with:**
+```bash
+cd "/Users/sebastianfrohlich/Library/Mobile Documents/com~apple~CloudDocs/Jupyter Notebooks/FinancialTrading/PlaceOrder/placeorder"
+
+# Run Option 2 commands above
+```
+
+---
+
+## 📦 What to Deploy to Windows Server
+
+**Copy only these to Windows Server:**
+
+```
+Essential Production Files:
+1. TradingBot_V1.6_Adaptive_Complete_CORRECTED.ipynb
+2. session_filter_patch.py
+3. infrastructure_patch.py
+4. trading_database.py
+5. telegram_notifier.py
+6. telegram_config.json
+7. trading_dashboard.py
+8. import_json_to_db.py (if you want to import JSON data)
+
+Optional:
+9. trade_performance_v16_XAUUSD_*.json (historical data)
+```
+
+**Don't copy:**
+- Documentation (read on Mac)
+- Analysis scripts (replaced by dashboard)
+- Archive folder (not needed)
+
+---
+
+Would you like me to execute the cleanup for you? Choose:
+- **A)** Option 1 - Full folder structure
+- **B)** Option 2 - Simple archive ⭐ Recommended
+- **C)** Option 3 - Delete old files
+- **D)** Do it manually