spip2pelican issueshttps://gitlab.math.unistra.fr/groupe-calcul/spip2pelican/-/issues2019-06-27T05:34:48Zhttps://gitlab.math.unistra.fr/groupe-calcul/spip2pelican/-/issues/27Make this project public2019-06-27T05:34:48ZMatthieu Boileaumatthieu.boileau@math.unistra.frMake this project public* [ ] Clean code
* [ ] Clean non public information* [ ] Clean code
* [ ] Clean non public informationMatthieu Boileaumatthieu.boileau@math.unistra.frMatthieu Boileaumatthieu.boileau@math.unistra.frhttps://gitlab.math.unistra.fr/groupe-calcul/spip2pelican/-/issues/26Keep a reference to the original spip article in new article metadata2019-06-27T05:34:01ZMatthieu Boileaumatthieu.boileau@math.unistra.frKeep a reference to the original spip article in new article metadataSee this [issue](../../website/issues/188#note_10195).See this [issue](../../website/issues/188#note_10195).Matthieu Boileaumatthieu.boileau@math.unistra.frMatthieu Boileaumatthieu.boileau@math.unistra.frhttps://gitlab.math.unistra.fr/groupe-calcul/spip2pelican/-/issues/25Handle restructured text export2019-03-30T13:02:43ZMatthieu Boileaumatthieu.boileau@math.unistra.frHandle restructured text exportLoïc Gouarinloic.gouarin@polytechnique.eduLoïc Gouarinloic.gouarin@polytechnique.eduhttps://gitlab.math.unistra.fr/groupe-calcul/spip2pelican/-/issues/24Build a list of all converted articles2018-07-20T09:28:14ZMatthieu Boileaumatthieu.boileau@math.unistra.frBuild a list of all converted articlesIn order to prepare a manual review...
- use markdown formatting
- sort by rubrique
- add a checkbox `* [ ]`In order to prepare a manual review...
- use markdown formatting
- sort by rubrique
- add a checkbox `* [ ]`Matthieu Boileaumatthieu.boileau@math.unistra.frMatthieu Boileaumatthieu.boileau@math.unistra.frhttps://gitlab.math.unistra.fr/groupe-calcul/spip2pelican/-/issues/23Handle unindexed images2018-06-29T15:00:07ZMatthieu Boileaumatthieu.boileau@math.unistra.frHandle unindexed imagessuch as :
```python
Traceback (most recent call last):
File "./spip2pelican.py", line 651, in <module>
website.export_to_pelican()
File "./spip2pelican.py", line 608, in export_to_pelican
skip_reason = article.export_to_pelic...such as :
```python
Traceback (most recent call last):
File "./spip2pelican.py", line 651, in <module>
website.export_to_pelican()
File "./spip2pelican.py", line 608, in export_to_pelican
skip_reason = article.export_to_pelican()
File "./spip2pelican.py", line 382, in export_to_pelican
content = spip_to_markdown(self.text, self.website)
File "./spip2pelican.py", line 273, in spip_to_markdown
s = document(s, website)
File "./spip2pelican.py", line 224, in document
s = re.sub(r'<(doc|img)([0-9]+)\|.*>', doc_replace, s)
File "/Users/boileau/anaconda3/lib/python3.6/re.py", line 191, in sub
return _compile(pattern, flags).sub(repl, string, count)
File "./spip2pelican.py", line 217, in doc_replace
url = os.path.join(website.attachments_prefix, "IMG", website.doc_index[doc_id])
KeyError: 26
```
Ignore image and output a warning.Matthieu Boileaumatthieu.boileau@math.unistra.frMatthieu Boileaumatthieu.boileau@math.unistra.frhttps://gitlab.math.unistra.fr/groupe-calcul/spip2pelican/-/issues/22Color logging for postprocess_yaml.py2018-06-27T14:49:50ZMatthieu Boileaumatthieu.boileau@math.unistra.frColor logging for postprocess_yaml.pyMatthieu Boileaumatthieu.boileau@math.unistra.frMatthieu Boileaumatthieu.boileau@math.unistra.frhttps://gitlab.math.unistra.fr/groupe-calcul/spip2pelican/-/issues/21Handle articles merging2018-06-27T13:59:06ZMatthieu Boileaumatthieu.boileau@math.unistra.frHandle articles mergingSome rubriques contain several articles that should be merged in a single page article.
Example :
```bash
spip articles that belong to rubrique 77: Ecole Thématique du GDR Calcul, 2010 : "Méthodes multirésolution et méthodes de raffinem...Some rubriques contain several articles that should be merged in a single page article.
Example :
```bash
spip articles that belong to rubrique 77: Ecole Thématique du GDR Calcul, 2010 : "Méthodes multirésolution et méthodes de raffinement adaptatif de maillage"
- 131 # Ecole Thématique du GDR Calcul : "Méthodes multirésolution et méthodes de raffinement adaptatif de maillage"
- 139 # Inscription et hébergement
- 138 # Confirmation de pré-inscription à l'Ecole Thématique
- 141 # Programme détaillé
- 147 # Informations pratiques
```Matthieu Boileaumatthieu.boileau@math.unistra.frMatthieu Boileaumatthieu.boileau@math.unistra.frhttps://gitlab.math.unistra.fr/groupe-calcul/spip2pelican/-/issues/20Convert get_attached_files.sh into python2018-06-27T13:30:08ZMatthieu Boileaumatthieu.boileau@math.unistra.frConvert get_attached_files.sh into pythonUse pyyaml to read website URL in `config.yml`Use pyyaml to read website URL in `config.yml`Matthieu Boileaumatthieu.boileau@math.unistra.frMatthieu Boileaumatthieu.boileau@math.unistra.frhttps://gitlab.math.unistra.fr/groupe-calcul/spip2pelican/-/issues/19Merge yaml_cleaner.py and process_yaml.py in a single file2018-06-27T13:30:08ZMatthieu Boileaumatthieu.boileau@math.unistra.frMerge yaml_cleaner.py and process_yaml.py in a single fileMatthieu Boileaumatthieu.boileau@math.unistra.frMatthieu Boileaumatthieu.boileau@math.unistra.frhttps://gitlab.math.unistra.fr/groupe-calcul/spip2pelican/-/issues/18Handle article-to-category classification2018-06-27T13:30:08ZMatthieu Boileaumatthieu.boileau@math.unistra.frHandle article-to-category classification`{id_rubrique: pelican_category}` is not enough to classify spip_articles: the `config.yml` should provide an additional `{id_article: pelican_category}` classification.`{id_rubrique: pelican_category}` is not enough to classify spip_articles: the `config.yml` should provide an additional `{id_article: pelican_category}` classification.Matthieu Boileaumatthieu.boileau@math.unistra.frMatthieu Boileaumatthieu.boileau@math.unistra.frhttps://gitlab.math.unistra.fr/groupe-calcul/spip2pelican/-/issues/17Add a switch for breves export2018-06-27T12:58:07ZMatthieu Boileaumatthieu.boileau@math.unistra.frAdd a switch for breves exportUser may want to export or not the spip breves.User may want to export or not the spip breves.Matthieu Boileaumatthieu.boileau@math.unistra.frMatthieu Boileaumatthieu.boileau@math.unistra.frhttps://gitlab.math.unistra.fr/groupe-calcul/spip2pelican/-/issues/16Ajout des liens vers les breves2018-06-06T20:21:33ZMatthieu Boileaumatthieu.boileau@math.unistra.frAjout des liens vers les breves`[...->brev#]``[...->brev#]`Matthieu Boileaumatthieu.boileau@math.unistra.frMatthieu Boileaumatthieu.boileau@math.unistra.frhttps://gitlab.math.unistra.fr/groupe-calcul/spip2pelican/-/issues/15Ajouter les brèves2018-06-06T15:00:04ZMatthieu Boileaumatthieu.boileau@math.unistra.frAjouter les brèvesElles sont dans la table `spip_breves`.Elles sont dans la table `spip_breves`.Matthieu Boileaumatthieu.boileau@math.unistra.frMatthieu Boileaumatthieu.boileau@math.unistra.frhttps://gitlab.math.unistra.fr/groupe-calcul/spip2pelican/-/issues/14Gérer les auteurs2018-06-06T15:00:04ZMatthieu Boileaumatthieu.boileau@math.unistra.frGérer les auteurs- la table `spip_auteurs` contient la liste des auteurs d'articles
- la table `spip_auteurs_liens` contient l'`id_auteur` pour chaque page (de type article, rubrique, etc.)- la table `spip_auteurs` contient la liste des auteurs d'articles
- la table `spip_auteurs_liens` contient l'`id_auteur` pour chaque page (de type article, rubrique, etc.)Matthieu Boileaumatthieu.boileau@math.unistra.frMatthieu Boileaumatthieu.boileau@math.unistra.frhttps://gitlab.math.unistra.fr/groupe-calcul/spip2pelican/-/issues/13Wrong <img|...> conversion2018-06-06T09:50:38ZMatthieu Boileaumatthieu.boileau@math.unistra.frWrong <img|...> conversion```bash
find content -name "*.md" |xargs grep "</img"
content/formations/spip_article-220.md: </img122|center>
content/formations/spip_article-220.md:</img125|center>
content/formations/spip_article-257.md: </img346...```bash
find content -name "*.md" |xargs grep "</img"
content/formations/spip_article-220.md: </img122|center>
content/formations/spip_article-220.md:</img125|center>
content/formations/spip_article-257.md: </img346|mode_force=image|largeur=140>
content/formations/spip_article-257.md: </img344|mode_force=image|largeur=100>
content/formations/spip_article-257.md: </img371|mode_force=image|largeur=140>
content/formations/spip_article-257.md:</img407|center|mode_force=image|largeur=300>
content/formations/spip_article-281.md:</img479|center>
content/formations/spip_article-284.md:</img492|center>
content/formations/spip_rubrique-93.md:</img43|right>
content/formations/spip_rubrique-95.md:</img43|right>
content/formations/spip_rubrique-98.md: </img122|center>
content/formations/spip_rubrique-98.md:</img125|center>
content/journees/spip_article-214.md:</img85|center>
content/paysage/spip_article-19.md: </img293|center>
content/paysage/spip_article-19.md: </img292|center>
content/paysage/spip_article-19.md:</img291|center>
```Matthieu Boileaumatthieu.boileau@math.unistra.frMatthieu Boileaumatthieu.boileau@math.unistra.frhttps://gitlab.math.unistra.fr/groupe-calcul/spip2pelican/-/issues/12Still some formatting conversion issues2018-06-27T14:48:27ZMatthieu Boileaumatthieu.boileau@math.unistra.frStill some formatting conversion issuesCurrently, we have:
```bash
find content -name "*.md" |xargs grep -l "{[^filename]" |wc -l
33
```
so 33 files with badly converted text formatting.Currently, we have:
```bash
find content -name "*.md" |xargs grep -l "{[^filename]" |wc -l
33
```
so 33 files with badly converted text formatting.Matthieu Boileaumatthieu.boileau@math.unistra.frMatthieu Boileaumatthieu.boileau@math.unistra.frhttps://gitlab.math.unistra.fr/groupe-calcul/spip2pelican/-/issues/11Add a conf.yaml for input parameters2018-06-02T13:56:55ZMatthieu Boileaumatthieu.boileau@math.unistra.frAdd a conf.yaml for input parameters```python
SITE_URL = "http://calcul.math.cnrs.fr"
AUTHORS = "Groupe Calcul"
CATEGORIES = {4: "journees", 39: "formations", 6: "paysage", 10: "paysage", 14: "paysage", 2: "groupe", 49: "skip",
-1: "spip_divers"}
ATTACHMENTS_...```python
SITE_URL = "http://calcul.math.cnrs.fr"
AUTHORS = "Groupe Calcul"
CATEGORIES = {4: "journees", 39: "formations", 6: "paysage", 10: "paysage", 14: "paysage", 2: "groupe", 49: "skip",
-1: "spip_divers"}
ATTACHMENTS_PREFIX = "attachments/spip/"
```
should be set using a config file.Matthieu Boileaumatthieu.boileau@math.unistra.frMatthieu Boileaumatthieu.boileau@math.unistra.frhttps://gitlab.math.unistra.fr/groupe-calcul/spip2pelican/-/issues/10log to file for conversion warnings2018-06-06T09:51:47ZMatthieu Boileaumatthieu.boileau@math.unistra.frlog to file for conversion warningsMatthieu Boileaumatthieu.boileau@math.unistra.frMatthieu Boileaumatthieu.boileau@math.unistra.frhttps://gitlab.math.unistra.fr/groupe-calcul/spip2pelican/-/issues/9Add a summary of converted/skipped articles2018-06-02T06:11:46ZMatthieu Boileaumatthieu.boileau@math.unistra.frAdd a summary of converted/skipped articlesMatthieu Boileaumatthieu.boileau@math.unistra.frMatthieu Boileaumatthieu.boileau@math.unistra.frhttps://gitlab.math.unistra.fr/groupe-calcul/spip2pelican/-/issues/8Handle html content2018-06-01T08:40:33ZMatthieu Boileaumatthieu.boileau@math.unistra.frHandle html contentTypically in
```html
<a href="URL">Text</a>
```
`"URL"` has to be changed because it may refer to an absolute html page or document file path in the old Spip site.Typically in
```html
<a href="URL">Text</a>
```
`"URL"` has to be changed because it may refer to an absolute html page or document file path in the old Spip site.Matthieu Boileaumatthieu.boileau@math.unistra.frMatthieu Boileaumatthieu.boileau@math.unistra.fr